Scrapebox YP scraper is very slow

nakatoo · Aug 26, 2018

I have been scraping yp.com for the last 24 hours using 70 proxies and running at 10 connections but it seems like it's going to take forever to scrape all 16k locations with these settings.

@loopline any advice on what the optimum number of connections per proxies is.

Will leaving out some business details such zip, location, etc. have any impact on the speed of scraping?

Visual Eagle · Aug 26, 2018

70 proxies and only 10 connections? The over kill

I would bump up the threads if your PC and internet can handle it to at least 25 or 30. Are those back connect proxies?

nakatoo · Aug 26, 2018

Thanks @Visual Eagle

These are semi-dedicated proxies from buyproxies.org.

loopline · Aug 27, 2018

nakatoo said:
I have been scraping yp.com for the last 24 hours using 70 proxies and running at 10 connections but it seems like it's going to take forever to scrape all 16k locations with these settings.

@loopline any advice on what the optimum number of connections per proxies is.

Will leaving out some business details such zip, location, etc. have any impact on the speed of scraping?

Leaving out details will not help it.

10 connections may get your ips banned for going too fast, but you can try it. You will have to toy with it. Yellow pages doesn't like their data scraped so they ban pretty fast and unban in a matter of hours.

That said, its a lot of data and yes it takes a minute, or forever, which ever way you want to look at it, LOL

Scrapebox YP scraper is very slow

nakatoo

Junior Member

Attachments

Visual Eagle

Elite Member

nakatoo

Junior Member

loopline

Elite Member

Main Menu

Marketplace

Making Money

BlackHat World