Scrapebox Meta Scraper Delay Setting

*Heracles* · Feb 18, 2020

Hi Folks,

Do you need to run proxies when using Scrapebox Meta Scraper on a single domain like linkedin? Can I delay the requests to a point where proxies are no longer required? I have been having a bunch of performance issues with the public proxies.

*Heracles* · Feb 18, 2020

*Heracles* said:
Hi Folks,

Do you need to run proxies when using Scrapebox Meta Scraper on a single domain like linkedin? Can I delay the requests to a point where proxies are no longer required? I have been having a bunch of performance issues with the public proxies.

@loopline are you able to share any wisdom on this one?

yherrliche · Feb 18, 2020

From my experience it was really hard to meta scrape linkedin, I was getting a 999 error whatever I was doing, with or without proxy, even on a super low thread.
Is that the error you're getting too ?

*Heracles* · Feb 18, 2020

yherrliche said:
From my experience it was really hard to meta scrape linkedin, I was getting a 999 error whatever I was doing, with or without proxy, even on a super low thread.
Is that the error you're getting too ?[/QUOTE

The connection for me is just dropping out. It seems like google is blocking the IP super quick or my proxies are sucking. I wondered if I might be able to slow the scrap down to workaround the google gatekeepers.

loopline · Feb 19, 2020

*Heracles* said:
Hi Folks,

Do you need to run proxies when using Scrapebox Meta Scraper on a single domain like linkedin? Can I delay the requests to a point where proxies are no longer required? I have been having a bunch of performance issues with the public proxies.

Are you using the meta scraper or the Google meta scraper.

The meta scraper goes straight to linkedin, and you will probably need uber small batches or private proxies for accurate results.

If you are talking the google meta scraper, that does not query linkedin at all, only google, so you could in theory get away with it, although google tightened up on ip bans in Jan of this year. But you can still use a big delay and a handful of private proxies and probably get somewhere.

But yes I never use public proxies, they annoy me, I just want stuff to work and I dont' have time to squirrel around with it. which is why I buy proxies.

gossipvivi · Mar 23, 2023

@loopline , May I know why I can't get any data from google meta scraper. It can scrape url from google... The error in scrapebox\Addons\ScrapeBox Google Meta Scraper\error.txt is Error receiving data: (12030) The connection to the server was terminated unexpectedly... I have tried 1 connection and timeout is largest, still failed.

Maybe useragent is wrong? I have tried change useragent same with PC chrome version, also failed.
Can you help？

loopline · Mar 23, 2023

gossipvivi said:
@loopline , May I know why I can't get any data from google meta scraper. It can scrape url from google... The error in scrapebox\Addons\ScrapeBox Google Meta Scraper\error.txt is Error receiving data: (12030) The connection to the server was terminated unexpectedly... I have tried 1 connection and timeout is largest, still failed.
Maybe useragent is wrong? I have tried change useragent same with PC chrome version, also failed.
Can you help？

I have never seen such an error from google, taht is more then likely related to the proxies or security software. So try a test with proxies off, and make sure you add an exception for the entire scrapebox folder in all security software.

gossipvivi · Mar 24, 2023

loopline said:
I have never seen such an error from google, taht is more then likely related to the proxies or security software. So try a test with proxies off, and make sure you add an exception for the entire scrapebox folder in all security software.

Thank you for your reply. If I don't use proxy in Scrapebox, I can't grab URL any more(with proxies in Scrapebox can). But I can use google brower to visit google&search for google result. By the way, I must use VPN to use google brower as I'm using Chinese VPS. So I need to switch to other country VPS like US VPS?

gossipvivi · Mar 24, 2023

loopline said:
I have never seen such an error from google, taht is more then likely related to the proxies or security software. So try a test with proxies off, and make sure you add an exception for the entire scrapebox folder in all security software.

Hello Loopline, Yes, I tried to turn off proxies when scrape google Meta Scraper , it worked with VPN. But for a short time.
And with proxies ,can scrape google url, but fail to scrape google Meta Scraper, Why?
I have tested proxies.com, webshare.io , proxyrotator.com . All can't scrape Google Meta Scraper....
What should I do to solve this?

loopline · Mar 26, 2023

gossipvivi said:
Hello Loopline, Yes, I tried to turn off proxies when scrape google Meta Scraper , it worked with VPN. But for a short time.
And with proxies ,can scrape google url, but fail to scrape google Meta Scraper, Why?
I have tested proxies.com, webshare.io , proxyrotator.com . All can't scrape Google Meta Scraper....
What should I do to solve this?

but it works when you use a VPN? or are you saying a vps? Like are you connecting to another server or are you just connecting to a vpn that gives you a new ip?

If its a vpn the only thing I can think is somehow security software is blocking teh requests on proxies and not the vpn. so you can add an exception for the entire scrapebox folder in all security software.

The Heisenberg · Mar 30, 2023

How can I use this mate. Give me some more details.

loopline · Apr 11, 2023

gdnnetworks said:
How can I use this mate. Give me some more details.

https://www.scrapebox.com/

Scrapebox Meta Scraper Delay Setting

Heracles

Registered Member

Heracles

Registered Member

yherrliche

Senior Member

Heracles

Registered Member

loopline

Elite Member

gossipvivi

Newbie

loopline

Elite Member

gossipvivi

Newbie

gossipvivi

Newbie

loopline

Elite Member

The Heisenberg

Regular Member

loopline

Elite Member

Main Menu

Marketplace

Making Money

BlackHat World