Scraping Noob Question
- Thread starter rodol
- Start date
ikstob
Junior Member
- Nov 12, 2012
- 147
- 130
typically you will start with a basic footprint like "powered by wordpress" and then add variations like:
Variations on the domain:
Variations by keyword, for example "cheese":
Very quickly you could have hundreds of these variations to feed Scrapebox, once you've scraped all these links you'll need to do a little post-processing to pull out only the unique ones then you could end up with 100,000+ links.
Variations on the domain:
Code:
site:.edu "powered by wordpress"
site:.com "powered by wordpress"
site:.org "powered by wordpress"
site:.net "powered by wordpress"
site:.co.uk "powered by wordpress"
site:.info "powered by wordpress"Variations by keyword, for example "cheese":
Code:
cheese "powered by wordpress"
brie "powered by wordpress"
cheddar "powered by wordpress"
stilton "powered by wordpress"
gouda "powered by wordpress"
ricotta "powered by wordpress"Very quickly you could have hundreds of these variations to feed Scrapebox, once you've scraped all these links you'll need to do a little post-processing to pull out only the unique ones then you could end up with 100,000+ links.
If you search similar keywords like "dog training, dog training guide, how to train your dog" remember to delete duplicate URL's it will save a lot of time.
frazgta
Power Member
- Jan 24, 2011
- 574
- 383
Yea. So more the keywords, more the results. Also there will be A LOT of duplicate URLs. Remember to delete them afterwards.