Scrapebox YP Scraper only scraping 10 records!

DanTe_0101 · Jul 25, 2021

Hi,

I ran into this issue since a few days and its still the same.

I set the connections 50 and even 1 the result is always the same. It just stops after scraping 10 records.

Is is because my ip got busted? Because I tried it some days ago and it worked well once or twice but now its not working.

Th3 D3str0yer · Jul 25, 2021

It seems your IP got blacklisted, are u running it VPS or your own PC.

DanTe_0101 · Jul 25, 2021

Th3 D3str0yer said:
It seems your IP got blacklisted, are u running it VPS or your own PC.

my own pc but when I open the yellowpages on my browser it works... so if it was blacklisted then the website shouldn't load right.

loopline · Jul 25, 2021

It stops after 10 records because you have total records set to 10.

If you want more then 10 results you need to set that total results box higher or you can set it to 0 to get all the results possible. The results per keywords box still applies as well, so you may want to set it to 0 for max results.

DanTe_0101 · Jul 26, 2021

loopline said:
It stops after 10 records because you have total records set to 10.

If you want more then 10 results you need to set that total results box higher or you can set it to 0 to get all the results possible. The results per keywords box still applies as well, so you may want to set it to 0 for max results.

That's it I'm going to get my eyes check... No way I didn't see that lol.

Thanks loopline!!

I have another question though, how can I avoid duplicates?

Last time I tried scraping it scraped 1M+ records but only 60k were unique. Hugely disappointed but I was wondering how can I stop duplicates records from getting scraped? Its just waste of time.

My settings were like this.

Yellowpages.com
1 keyword
All locations
25 connections

loopline · Jul 28, 2021

DanTe_0101 said:
That's it I'm going to get my eyes check... No way I didn't see that lol.

Thanks loopline!!

I have another question though, how can I avoid duplicates?

Last time I tried scraping it scraped 1M+ records but only 60k were unique. Hugely disappointed but I was wondering how can I stop duplicates records from getting scraped? Its just waste of time.

My settings were like this.

Yellowpages.com
1 keyword
All locations
25 connections

You can't stop duplicate from being scraped, but you can filter them. I mean yellow pages displays results from a wide area beyond what you input, its how they work, so the best way is to just remove them using one of the filters in the yellow pages plugin after its done scraping.

You could try spreading out your area, but it just depends, you may lose some accuracy.

DanTe_0101 · Jul 28, 2021

loopline said:
You can't stop duplicate from being scraped, but you can filter them. I mean yellow pages displays results from a wide area beyond what you input, its how they work, so the best way is to just remove them using one of the filters in the yellow pages plugin after its done scraping.

You could try spreading out your area, but it just depends, you may lose some accuracy.

I just scraped 2.8M records and only 45k are unique

I used 1 kw and "all locations"

It was on for almost 30+ hrs.

Probably need to put more keywords and limit the no of records to 60k ish

azbotboyz · Jul 29, 2021

The problem is the pagination of youtube scraper is no longer work due to new youtube theme. So it only 20 unique video per keyword

Scrapebox YP Scraper only scraping 10 records!

DanTe_0101

Supreme Member

Th3 D3str0yer

Junior Member

DanTe_0101

Supreme Member

loopline

Elite Member

DanTe_0101

Supreme Member

loopline

Elite Member

DanTe_0101

Supreme Member

azbotboyz

Regular Member

Main Menu

Marketplace

Making Money

BlackHatWorld

Other