Scrape box returning wrong URLS

[Br4mz]

Hi guys,

So im using Scrapebox for prospecting and im searching the following strings

turf online
buy tools online
wine store online
online cycling store
natural supplements

My goal is to return single websites that sell these goods. However, what im getting is the same certain site 4, 5, 6 times in some cases. This shouldn't be the case: https://i.imgur.com/JbKtHlR.png

I have searched the strings on my browser and the same URL doesn't appear more than twice for any of the results. This is the first time iv had this problem. Scrape box is searching for the incorrect result.

Im using the UK search engine with this search string: http://www.google.co.uk/search?complete=0&hl=en&q={KEYWORD}&num=100&start={PAGENUM}&filter=0&pws=0

Any help would be greatly appreciated.

 

[karbofoni]

Hi. On the right top corner of main screen you got 'manage lists'. Click first one 'remove / filter' and then pick 'remove duplicate domain's' or whatever.

 

[Br4mz]

Hi. On the right top corner of main screen you got 'manage lists'. Click first one 'remove / filter' and then pick 'remove duplicate domain's' or whatever.

Yes I know that, the problem is that the harvester is returning the wrong list of URLS basically

 

[AmRyanThomas]

For some people its still working

 

[Br4mz]

For some people its still working

Mine just started doing this today, its never happened before

 

[Br4mz]

Hi. On the right top corner of main screen you got 'manage lists'. Click first one 'remove / filter' and then pick 'remove duplicate domain's' or whatever.

Can anyone help?

 

[james bram]

Yeah it started happening to me, anyone got a fix?

 

[karbofoni]

Yes I know that, the problem is that the harvester is returning the wrong list of URLS basically

Just looked at mine, you're right, I got the same :/
No idea why this happens :/

 

[gman777]

Perhaps @loopline can answer to this.

 

[loopline]

How many results are you scraping?

Basically google returns different sets of results for all sorts of reasons, including user agent, ip, 100 vs 10 results and many other things.

But scrapebox is seen by google as a browser, so its only giving you what it gets from google. The question is, why is it getting what it gets. Further the question is are you the exception?

I mean 95% of people might get what scrapebox gets and you are the few % who gets what you get. But in truth, google doesn't return the same results for even probably 25% of people.

It seems insane, but I can vary multiple things on my pc and get so many like more then a dozen different sets of results. Some of them have some urls, others don't even show domains that show up in some results, all for the exact same keyword.

So you can go to remove/filter >>remove duplicate domains and just remove duplicate domains. But if you look at it in a debugger your going to find that the results you get are the same results scrapebox gets, and thats not a fault of scrapebox, but simply how google works.

This of course assumes you have the custom fooptrint box checked and not the platforms button.

 

[NobelNerd]

How many results are you scraping?

Basically google returns different sets of results for all sorts of reasons, including user agent, ip, 100 vs 10 results and many other things.

But scrapebox is seen by google as a browser, so its only giving you what it gets from google. The question is, why is it getting what it gets. Further the question is are you the exception?

I mean 95% of people might get what scrapebox gets and you are the few % who gets what you get. But in truth, google doesn't return the same results for even probably 25% of people.

It seems insane, but I can vary multiple things on my pc and get so many like more then a dozen different sets of results. Some of them have some urls, others don't even show domains that show up in some results, all for the exact same keyword.

So you can go to remove/filter >>remove duplicate domains and just remove duplicate domains. But if you look at it in a debugger your going to find that the results you get are the same results scrapebox gets, and thats not a fault of scrapebox, but simply how google works.

This of course assumes you have the custom fooptrint box checked and not the platforms button.

Hey can you help me out I was in rehab (https://www.blackhatworld.com/seo/back-from-rehab.977704/) and my office people threw away the file containing details and the details I have in mail not logging in scrapebox and scrapebox support is not answering me either

 

[Sweetfunny]

I have searched the strings on my browser and the same URL doesn't appear more than twice for any of the results. This is the first time iv had this problem. Scrape box is searching for the incorrect result.

Im using the UK search engine with this search string: http://www.google.co.uk/search?complete=0&hl=en&q={KEYWORD}&num=100&start={PAGENUM}&filter=0&pws=0

Any help would be greatly appreciated.

I'm seeing the same thing in my browser, for example this search https://www.google.co.uk/search?com...ine&num=100&start=0&filter=0&pws=0&gws_rd=ssl

Returns the same few sites numerous times just on the first page. This is a combination of you using Google.co.uk and using 100 results per page which tends to return more urls from the same domain as 10 results per page does.

But ScrapeBox isn't searching for the wrong thing or returning the wrong URL's, it's fetching exactly what Google is returning for the search string and keywords you are using. You have full control over what's happening and can customize the engine completely, for example removing &filter=0 from your URL string will return more mixed results.

Hey can you help me out I was in rehab (https://www.blackhatworld.com/seo/back-from-rehab.977704/) and my office people threw away the file containing details and the details I have in mail not logging in scrapebox and scrapebox support is not answering me either

Please check your spam folder, you would of had a reply sent.

 

[NobelNerd]

Please check your spam folder, you would of had a reply sent.

Nope nothing I will PM you my email address
edit - no option to pm you here

 

[loopline]

Nope nothing I will PM you my email address
edit - no option to pm you here

you can pm me if you want and I Can contact support for you.

 

[NobelNerd]

you can pm me if you want and I Can contact support for you.

Done