dirtysecret
Regular Member
- Joined
- Dec 12, 2008
- Messages
- 298
- Reaction score
- 21
I'm using Awstats in Cpanel for my hosting.
How can I tell if the MSN bot has spidered me?
I'm trying out the "MSN loophole" method (if you've heard of it) and it relies entirely on getting the msn bot to spider and index your sites. THe trouble is I have no idea what to look for. I may or may not have been to my site yet, but if it has, awstats isn't showing anything obvious to indicate that it has.
Google & Yahoos bots have very obvious names (googlebot & yahoo slurp), however, the only other things that show up under robots/spiders is "netcraft" (n f'ing idea) and "unknow robot".
How can I tell if the MSN bot has spidered me?
I'm trying out the "MSN loophole" method (if you've heard of it) and it relies entirely on getting the msn bot to spider and index your sites. THe trouble is I have no idea what to look for. I may or may not have been to my site yet, but if it has, awstats isn't showing anything obvious to indicate that it has.
Google & Yahoos bots have very obvious names (googlebot & yahoo slurp), however, the only other things that show up under robots/spiders is "netcraft" (n f'ing idea) and "unknow robot".