Scrapebox Google Engine Issue: Can't Get More Than 100 Results! Help!

[mhdfaran]

I am having an issue where scrapebox only harvesting around 100 results. This seems to be the issue in google harvesting setting.

I am using private proxies. I even tried without proxies.

Tested with different footprints as well.

I have also attached the screenshot for my current settings of google engine.

Need help.

 

[Steptoe]

Google have been tinkering with their SERPs html code again. In the 'Marker for "Next page"' section, try adding this line:

>Next</span>

 

[mhdfaran]

Google have been tinkering with their SERPs html code again. In the 'Marker for "Next page"' section, try adding this line:

>Next</span>

After I added it. Its stopping after 319.

 

[HeavyMorning]

Why not try solutions like scraping robot? cheapest and hassle-free, as anyways you will be spending on proxies.

 

[Steptoe]

After I added it. Its stopping after 319.

300-400 results is the max you'll get from any Google search nowadays. Try it yourself manually and you'll see.

 

[mhdfaran]

300-400 results is the max you'll get from any Google search nowadays. Try it yourself manually and you'll see.

It means I gotta use a lot of keywords. Thanks for the help.

 

[LX911]

Anyone can share the best harvesting schema?

 

[Steptoe]

Anyone can share the best harvesting schema?

For guaranteed scraped results you can try many of the SERP APIs, such as this one in the BHW marketplace: https://www.blackhatworld.com/seo/serp-data-api-for-developers-serpextractor-com.1669161/

As far as off-the-shelf scrapers go, I believe A-Parser has been updated for scraping the new-style SERPs, whilst Scrapebox has a startup message saying they're working on it...

 

[jimbobo2779]

For guaranteed scraped results you can try many of the SERP APIs, such as this one in the BHW marketplace: https://www.blackhatworld.com/seo/serp-data-api-for-developers-serpextractor-com.1669161/

As far as off-the-shelf scrapers go, I believe A-Parser has been updated for scraping the new-style SERPs, whilst Scrapebox has a startup message saying they're working on it...

They aren't still "working on it" are they? How do they not have it fixed yet? It took me less than 24 hours from the update before it was back working in my software and a ton of services.

I thought they were still doing updates on it, it shouldn't be a hard update to implement. I wonder what's going on with them.

 

[Steptoe]

They aren't still "working on it" are they? How do they not have it fixed yet? It took me less than 24 hours from the update before it was back working in my software and a ton of services.

I thought they were still doing updates on it, it shouldn't be a hard update to implement. I wonder what's going on with them.

I stand corrected!


Looks like quite a major update to the harvesting functions. I'll have a play around with it later on today or tomorrow.

 

[Steptoe]

Well the new update 'works' in that you can indeed scrape Google results, in a slow and steady manner. It does make Scrapebox not really suitable for bulk scraping any more, and the memory footprint is much larger now as multiple Chrome instances are opened up, it seems for each keyword given. It's certainly the biggest update the app has had in around a decade though.

 

[supAlc]

Use xrummers hrefs

But tbh it's not worth to scrape instead buy a link list ..

 

[jimbobo2779]

Use xrummers hrefs

But tbh it's not worth to scrape instead buy a link list ..

Back when I released No Hands SEO I would see people telling others to just buy a list because it takes too long to make your own. My issue with that is that then you are just getting the same spam links as anyone else using that list.

I made NHSEO to search for relevant targets and to post relevant-ish comments and found this to be far more useful than just blasting a billion links out and hoping for the best. You'd be amazed at how many people were getting first page rankings, just from that software (many thousands).

This was over 10 years ago so a lot has changed, but i would imagine that the best advice would still be to create your own, highly unique, backlink profile.

 

[Steptoe]

Use xrummers hrefs

Hrefer is scraping the new-style Google SERPs? Last time I looked it was mainly just Seznam and So.com that worked.

But tbh it's not worth to scrape instead buy a link list ..

There are many other uses for scraping data than just to feed urls into commercial link-building apps.

 

[atultanna88]

Back when I released No Hands SEO I would see people telling others to just buy a list because it takes too long to make your own. My issue with that is that then you are just getting the same spam links as anyone else using that list.

I made NHSEO to search for relevant targets and to post relevant-ish comments and found this to be far more useful than just blasting a billion links out and hoping for the best. You'd be amazed at how many people were getting first page rankings, just from that software (many thousands).

This was over 10 years ago so a lot has changed, but i would imagine that the best advice would still be to create your own, highly unique, backlink profile.

Why did u stop no hands seo Would yet to have that tool