Discussion in 'White Hat SEO' started by bizseo, Sep 4, 2010.
Can you see when the crawler visits your site ?
In your log files:
go to statcounter website >> register yourself >> create a script ( choose normal HTML script ) >> place the script just before the <body> tag in your html. If you are using wordpress blog, then open the footer file, you will find <body> tag there. Place the script before this tag.
Then login to stat counter and select "Recent visitor activity", you will see google bots entry there whenever bots arrive. The time there would be 0 seconds.
Hope this helps.
It's called user agent. Every webbrowser, crawler, etc. has it's own user agent.
Separate names with a comma.