Discussion in 'Black Hat SEO' started by nickk, Feb 22, 2009.
can anyone upload or let me know how i can find an updated spider ip list?
I used to use
but it looks like it hasn't been updated in a while... I've found it's hard to find and keep good updated lists unless your constantly lurking on webmaster forums.
I think the problem with spider ip lists, is that the big SEs like G are constantly changing their spider's IP ranges. So it's often better to identify spiders by user agent (this is even what big G recommends).
For that I have been using
Separate names with a comma.