1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Track Search Engine Indexing of Your Domain(s)

Discussion in 'Black Hat SEO' started by 7stars7stones, Aug 12, 2008.

  1. 7stars7stones

    7stars7stones Newbie

    Joined:
    Aug 12, 2008
    Messages:
    18
    Likes Received:
    9
    First of all, let me say that I am coming to this forum for a long time, just never felt like registering.

    Anyhow, little while back, I wrote this simple tool to check indexing of your websites in the most popular search engines. Originally this was to be used just by me alone, but then I've decided to release it online, so I can give something back to the community.

    Enjoy: http://www.TrackIndexing.com

    There might still be some glitches, so if something doesn't work, let me know and I'll fix it.

    /I'll be adding tracking of historic data soon. So you'll be able to see how your domains are indexed in search engines over the time./

    This is what it looks like as of now. Example for thestar.com:
    [​IMG]
     
    • Thanks Thanks x 8
    Last edited: Aug 12, 2008
  2. retsuca

    retsuca Newbie

    Joined:
    Jul 18, 2008
    Messages:
    21
    Likes Received:
    1
    Home Page:
    Nice tool 7star, it worked perfectly on all of my domains. I especially like the lively feeling it gives off (with all the color and nice animation).
     
  3. urbanzen

    urbanzen Junior Member

    Joined:
    Jul 16, 2008
    Messages:
    122
    Likes Received:
    11
    I'd suggest you add an email signup box (double opt in opportunity) as early as possible, to capitalize on this later on down the road, when you hire a team to further develop/monetize this idea.

    Although track spider tools are in abundance out there, your more graphical nature will be easier to market.

    Just my 2cents

    Urban
     
  4. 7stars7stones

    7stars7stones Newbie

    Joined:
    Aug 12, 2008
    Messages:
    18
    Likes Received:
    9
    Thanks, I have whole bunch of other tools I am planning to slowly release for you guys to enjoy. I will add them as the time goes.

    Currently I am working on adding in a tracking of domains in time. So you'd be able to see the daily, monthly, yearly (or all) graph of indexing of your website in google,yahoo,ask and live.com.

    Once that is done, I think it'll be useful for those of us, who deal with lot of domains and need to know these type of information.
     
  5. 7stars7stones

    7stars7stones Newbie

    Joined:
    Aug 12, 2008
    Messages:
    18
    Likes Received:
    9

    Hi Urban,

    I was thinking about that too. But then realized, that if it's popular it'll make it's share through google adsense, which we know is being placed on that page with the specific purpose :)

    77
     
  6. urbanzen

    urbanzen Junior Member

    Joined:
    Jul 16, 2008
    Messages:
    122
    Likes Received:
    11
    Forgot to mention, that the newsletter sign up box, you can say "Sign up now, and we'll tell you first hand when we release an update to trackspider.com, with more powerful, FREE, features!"

    do some {ul}{li} notes on what additions you'll add on further down the line, and why they should use your service. 2 or 4 will do.
     
  7. urbanzen

    urbanzen Junior Member

    Joined:
    Jul 16, 2008
    Messages:
    122
    Likes Received:
    11
    You have a lot of AD property on that page. Once your visitor count hits 3k daily uniques, you can start selling adspaces from...I can't think of any companies right now, but whatever shoe*monkey uses on his site, because your's is also internet research related.
     
  8. 7stars7stones

    7stars7stones Newbie

    Joined:
    Aug 12, 2008
    Messages:
    18
    Likes Received:
    9
    Urban, that is a great idea. I will try to implement something similar. Great input. Thanks.
     
  9. whatsup

    whatsup Registered Member

    Joined:
    Feb 2, 2008
    Messages:
    50
    Likes Received:
    7
    That's a nice looking tool. I would definitely try to monetize it.
     
  10. polymorphs

    polymorphs Newbie

    Joined:
    May 1, 2008
    Messages:
    43
    Likes Received:
    32
    I just had a play with your tool and I like it - pretty colors keep my attention lol

    As a suggestion is there any chance of adding the option of checking indexed pages on a sub domain only?

    Cheers
     
  11. 7stars7stones

    7stars7stones Newbie

    Joined:
    Aug 12, 2008
    Messages:
    18
    Likes Received:
    9
    That should be a huge problem to add. I'd have to change the domain name parser a bit, but it should be possible.
     
  12. boro

    boro Regular Member Premium Member

    Joined:
    Aug 6, 2008
    Messages:
    264
    Likes Received:
    161
    When I add mywebsite.co.uk and search it goes to .co.uk in the search box everytime but .com works.
    Works well though for .com
     
  13. scriptkiddy

    scriptkiddy Junior Member

    Joined:
    Jan 11, 2008
    Messages:
    104
    Likes Received:
    18
    I like the look of your site, the pie chat is clever and engaging, although I'm not sure it's actually useful. History graphs would be interesting. The numbers are useful for sure.

    I would consider adding stat-counter type tracking as an option, then you can show say G spider visits, G indexed pages, G links Y..etc.. and the history of each.

    I'm a little paranoid so I probably wouldn't sign-up to a service and give it any significant number of my domain names, any third party tracking of anything implies a risk. I would never use (for instance) Google Analytics and have more than one or two domains in an account. Yea paranoia, but I don't want Google to link my domains in any way

    However, there's certainly a need for this sort of thing, but you need some strong privacy statements.

    I do all of this tracking with my own private software, no graphics, but include revenue for each site, registration details expiry warning....
     
  14. kalekom

    kalekom Junior Member

    Joined:
    Jul 25, 2008
    Messages:
    172
    Likes Received:
    356
    Occupation:
    CEO - SEO
    Location:
    here
    Home Page:
    nice tool. tried it and clicked one ad to support your development :)
     
  15. 7stars7stones

    7stars7stones Newbie

    Joined:
    Aug 12, 2008
    Messages:
    18
    Likes Received:
    9
    Ok, that is definitely a glitch and I will try to fix it tonight. Also add sub-domain support.

    Regarding privacy, I don't see a problem, because you can see the very same details when you visit google,yahoo,ask or live.com and run site commands. This tool just brings it all together and ads some graphs to the picture (for comparison) :)

    77
     
  16. boro

    boro Regular Member Premium Member

    Joined:
    Aug 6, 2008
    Messages:
    264
    Likes Received:
    161
    Quick reply and I will use it once it is sorted
    Thanks
     
  17. scriptkiddy

    scriptkiddy Junior Member

    Joined:
    Jan 11, 2008
    Messages:
    104
    Likes Received:
    18
    Yes for one or two sites fine, no problem.

    But.. do you really believe that G doesn't store and potentially use the results from each search, particularly site: and link: searches ...

    If you have a subscription option and a user has 1000 sites that they don't want linked they would be silly to just give the list to someone.

    Ok paranoid I know. but I've had hundreds of sites banned from G so I take great pains to keep them seperate in many ways. Different registrars, different accounts, private registration, different hosting, breaking footprints, not interlinking except by design....

    Some things may not be necessary now, but they may be necessary tomorrow.

    If you look at what google shows in it's webmaster console about searches and search results it gives you an idea of what G does store. I'm sure they internally have much .. much more data. I'm sure that for instance a google employee could do a search for say, how many site: searches have been performed for website.com, and from what ip's. What sites have been searched with site: from ip xxx.xxx.xxx.xxx. What sites have a js file with function xxx.... What sites contain divs with id's xxx, yyy and zzz

    Google OWNS your data...

    By the way I'd avoid adsense on this sort of site. You are breaking G's TOS by performing automated searches so I'd consder monitizing some other way.
     
    Last edited: Aug 13, 2008
  18. brokentwo

    brokentwo Registered Member

    Joined:
    Feb 8, 2008
    Messages:
    96
    Likes Received:
    14
    Pretty nice tool,

    Would love for some more se's to be added to the list. =)
     
  19. battman323

    battman323 Regular Member

    Joined:
    Aug 10, 2007
    Messages:
    449
    Likes Received:
    395
    Occupation:
    Extortionist
    Location:
    None of your damn business
    I like it. Great work.

    Why would you want to add other SE's? They don't get any traffic of interest, unless you're referring to the regional versions of the major search engines.
     
  20. brokentwo

    brokentwo Registered Member

    Joined:
    Feb 8, 2008
    Messages:
    96
    Likes Received:
    14
    Yeah, I was hoping for country-specific data, google & yahoo are in a ton of different countries and it would be nice to know that data.