Quote:
Originally Posted by mr.breakit
I am trying to scrape some emails using the auto pager add on for firefox. there are no mods or other websites that have more than 100 pages, I would assume with all of these great minds there has to be some mod or somthing.
|
You can get past 1,000 URL's for a keyword but the way to go about it is fairly impractical. I don't know how your searching, but you can try keyword stemming like:
cell phones
cellular phones
And so on, or if your are pulling stuff from a site with more than 1,000 pages do it one section at a time like:
site:domain.com/computers/
site:domain.com/laptops/
You get the idea.