Soo
Id like to harvest 12k url from same key phrase or more likely from same website but google only gives up to 1000 =/ best way around this ?
Soo
Id like to harvest 12k url from same key phrase or more likely from same website but google only gives up to 1000 =/ best way around this ?
[your querry] + [keyword list]
edit:
hit the reputation button :P
Last edited by kouxx; 03-25-2009 at 11:43 PM.
i think site doesn't matterWell i tried with Diff KW got first like 6k results, when removed duplicates had 1.9k left lol :P oh well , thats a start.
drop me a pm... if you want
i have a tool for you..
also it is important to know that the number of hits google shows is usually WAY wrong.
If google says it knows a million websites about a topic it is very possible that you can not get out more than a few % of them and google does not really know much more.
I don't know how they estimate the total number of sites but that algorithm is very inaccurate at least.
Fresh, fast, reliable and stable private proxies SEO-proxies.com - HTTP, SOCKS, VPN, API
I have xrumer and hrefer.. could run for you a hrefer search.
I did some reading on this a few months ago because I ran into the same problem. It ''seems'' and I might be wrong, that its part of google's design not to go past 1000 results. They claim something like ''if you can't find it in the first 1000 results, your search isn't focused enough'' lol
▲
▲ ▲
and don't forget: if you hammer google too much you get soft banned which requires a captcha to continue.
If you continue to hammer google they temp ban your ip.
If you continue to use ips in the same subnet the same process happens.
if you keep hammering they temp ban the whole subnet.
After some hours to days the ban is lifted, no idea what happens if you keep scraping google, I read about permanent bans in various mailing lists.
Fresh, fast, reliable and stable private proxies SEO-proxies.com - HTTP, SOCKS, VPN, API
Bookmarks