Discussion in 'White Hat SEO' started by dombryan973, Sep 12, 2011.
im trying to get all 800,000 results from a google search..is this even possible?? if so how???
What exactly do you mean?
You're trying to scrape all 800k URLs that are in the results or you're trying to get all 800k pages to be yours?
It's impossible to get all 800k pages to be yours because you don't own all the sites (most likely).
lollll im trying to scrape all 800k URLs that are in the results
It's not possible to retrieve more than 1000 results per search. There are a few tricks you can use to retrieve different parts of those 800k URLs, however.
If you are searching something generic, for example, "cat", you will return millions of URLs. But if you narrow this footprint down into something like:
You will be able to broaden the amount of results you get by narrowing each individual search. You can expand this further by using unique footprints that will give you even more URLs. Here's a great video from loopline:
Use firefox "autopager addon" It will load next page automatically below the first one...
Set it to maximum in the option!
The maximum number of results I accessed through google are 1000. I never go for more after that.
I didn't get why you need all the results?
automate the following
randomword1 randomword2 randomword3 +##YOURKEYWORD##
Will give you more than a 1000 but you'll never get the 800k
Edit: Didn't see the video already posted!
I dont think it's possible to retrieve more than 1k results per search(well thats the max I get), If someone does know how to retrieve more than 1k results per search please share... I love to hear it too.
Yes, it is possible. Join GOOGLE
Look above you.!
Separate names with a comma.