- Aug 9, 2017
- 5,592
- 6,878
I reminded myself the other day that Yep still exists, and Ahrefs seems to be featuring it now in their tools suite, so I had a quick look at what it's like to scrape. Pretty simple as it turns out, so I've whipped up this engine for Scrapebox and attached it to the thread.
I couldn't really get any more than 100 results for most queries, so it just scrapes 1 page of max ~100 results for each query.
You can install it by unzipping the .dat file, then going to Settings > Harvester Engine Configuration > Import > Engine file to process > navigate to yep.dat file and click > make sure 'Add non-existing engines' radio is selected > Apply
They do start to ban IPs after a while (but with nowhere near the frequency that Google does), so if you run into errors either add a pause, lower your threads, or just use a shitload of proxies.
Happy scraping!
I couldn't really get any more than 100 results for most queries, so it just scrapes 1 page of max ~100 results for each query.
You can install it by unzipping the .dat file, then going to Settings > Harvester Engine Configuration > Import > Engine file to process > navigate to yep.dat file and click > make sure 'Add non-existing engines' radio is selected > Apply
They do start to ban IPs after a while (but with nowhere near the frequency that Google does), so if you run into errors either add a pause, lower your threads, or just use a shitload of proxies.
Happy scraping!
