Scrapebox Crashing

mac0312

Newbie
Joined
Dec 28, 2012
Messages
25
Reaction score
3
All,

So i am using scrapebox to gather URLs using foorprints from GSA. That last couple of nights Scrapebox has ben crashing around 300k urls scraped. I checked my proxies about 30 now- Shared,,, all past the anonymous test but not Google SearchI/m ok with that. Im running about 60 threads. I do see errors popped up on the right side of the screen Now when i start there are no errors but later on,, errors started popping up. then later the crash? Are my proxy threads to high?.. I reinstalled Scrapebox this morning but waiting on answer here b4 i try again. Ok i just checked all 30 passed anonymous ,, none passed Google on the scrapebox proxy test.
 
Last edited:
So your running 60 threads on 30 proxies on google... reduce that thread count by 59 and start there. Meaning running 1 thread.

Running 1 thread on 30 proxies is probably too fast, and you will probably need to use the detailed harvester and also use a delay, but you can test.

The errors are due to the proxies getting blocked, and typically once they are blocked it takes 24 to 48 hours for them to become unblocked. also the more often you get them blocked the faster google is going to block them and the longer they are going to stay blocked once they are, more or less.

That said, when you say it "crashes" does it close the scrapebox program down? Or does it pop an error box?

or what specifically happens when it crashes? I ask because many people describe "crash" as different things so clarity on that will help us (BHW) help you.
 
So your running 60 threads on 30 proxies on google... reduce that thread count by 59 and start there. Meaning running 1 thread.

Running 1 thread on 30 proxies is probably too fast, and you will probably need to use the detailed harvester and also use a delay, but you can test.

The errors are due to the proxies getting blocked, and typically once they are blocked it takes 24 to 48 hours for them to become unblocked. also the more often you get them blocked the faster google is going to block them and the longer they are going to stay blocked once they are, more or less.

That said, when you say it "crashes" does it close the scrapebox program down? Or does it pop an error box?

or what specifically happens when it crashes? I ask because many people describe "crash" as different things so clarity on that will help us (BHW) help you.
I have to restart the app each time. No messsage. Not using Google just errors before . Let me make sure I understand you-- are you say with 30 shared proxies use just 1 thread ? Right now I am at 900k urls and counting 8 hours . However yahoo and Search.com are putting up a bunch of errors Bing has 0 errors. I did not try Google at all. Are you saying 1 thread using Google? And Google would give me more URLs faster?
 
Last edited:
Google won't necessarily give you more urls faster with 1 thread. I guess it depends on your angle.

I want to setup something big and let it run for the most it can. So I have left stuff run for a month or more.

If you run 60 threads on 30 proxies, you will get a lot of results really fast from google... until they ban all your proxies and you will get zero results.

For me, I just need stuff to work, so you might get 300K urls before your IPs get banned and I might set it up for a month and get millions or 10s of millions of urls on 1 connection. It just depends on how much you need.

If your keyword list is small, its mute.

The only wrong answer is the one that doesn't work, so test it. Worst case you get your ips banned, wait 48 hours and try again.

But if other engines are working just as well and faster and you are happy with the results, then by all means don't even use google.

If you have to restart the app, it sounds like locked threads, which could be security software or a host of other things. So you can add an exception for the entire scrapebox folder in all security software. Also you can shut down any non crucial software.
 
Google won't necessarily give you more urls faster with 1 thread. I guess it depends on your angle.

I want to setup something big and let it run for the most it can. So I have left stuff run for a month or more.

If you run 60 threads on 30 proxies, you will get a lot of results really fast from google... until they ban all your proxies and you will get zero results.

For me, I just need stuff to work, so you might get 300K urls before your IPs get banned and I might set it up for a month and get millions or 10s of millions of urls on 1 connection. It just depends on how much you need.

If your keyword list is small, its mute.

The only wrong answer is the one that doesn't work, so test it. Worst case you get your ips banned, wait 48 hours and try again.

But if other engines are working just as well and faster and you are happy with the results, then by all means don't even use google.

If you have to restart the app, it sounds like locked threads, which could be security software or a host of other things. So you can add an exception for the entire scrapebox folder in all security software. Also you can shut down any non crucial software.
Just to update- 1.5 mill urls havested so far no errors on Bing . yahoo and search.com stll producing but are showing errors. 60% done
 
To scrape Google you'll need rotating proxies to avoid getting your proxies banned or like @loopline said use a really low thread and adjust from there
 
Since you've had success with Bing and others, it simply means that Google doesn't support the number of threads you're sending. You have to reduce them as recommended by other users.
 
put simple - the higher the thread rate - the quicker your proxies get banned
Thanks for the response Just to give an update 30 threads on 30 shared proxies returned 2.5 mil urls Google was not used. I used Bing ,Yahoo, and Search.com. Bing only had 2 errors. Not sure on on how good or bad my results were but those are the results
 
So your running 60 threads on 30 proxies on google... reduce that thread count by 59 and start there. Meaning running 1 thread.

Running 1 thread on 30 proxies is probably too fast, and you will probably need to use the detailed harvester and also use a delay, but you can test.

The errors are due to the proxies getting blocked, and typically once they are blocked it takes 24 to 48 hours for them to become unblocked. also the more often you get them blocked the faster google is going to block them and the longer they are going to stay blocked once they are, more or less.

That said, when you say it "crashes" does it close the scrapebox program down? Or does it pop an error box?

or what specifically happens when it crashes? I ask because many people describe "crash" as different things so clarity on that will help us (BHW) help you.
Hi, I'm already registered with WP https://scrapeboxmarketplace.com/
Why are there no tools for scrapebox?

Is scrapebox software different with WP https://scrapeboxmarketplace.com/
 
1643776068859.png

I already register on ScrapeboxMarketplace and paid $38 / month. But I check on that WP site is no tools for Scrapebox software. Can someone help me?
Thank you
 
View attachment 200873

I already register on ScrapeboxMarketplace and paid $38 / month. But I check on that WP site is no tools for Scrapebox software. Can someone help me?
Thank you
What "Tools" are you looking for?

The scrapebox marketplace sells auto approve lists that let you build links using fast poster in scrapebox, that is ALL that it sells, the lists, which are updated daily.


As @PHPInjected noted above, there is a tools menu in scrapebox the software. Further there are more then 20 addons that come with scrapebox, and then optionally the premium plugins which you can purchase. All of this is contained in the software. The software has nothing to do with the scrapebox marketplace, 2 different companies.

So what "Tools" are you looking for?
 
What "Tools" are you looking for?

The scrapebox marketplace sells auto approve lists that let you build links using fast poster in scrapebox, that is ALL that it sells, the lists, which are updated daily.


As @PHPInjected noted above, there is a tools menu in scrapebox the software. Further there are more then 20 addons that come with scrapebox, and then optionally the premium plugins which you can purchase. All of this is contained in the software. The software has nothing to do with the scrapebox marketplace, 2 different companies.

So what "Tools" are you looking for?
@loopline Ok, let me check, thank you
 
who do i contact about not receiving the premium article scraper addon i purchased via my scrapebox?


PayPal

You paid $20.00 USD
to Scraped Media Pty LtdDetails




Paid with
VISA-2168$20.00 USDThis transaction will appear on your statement as PAYPAL *SCRAPEDMEDI
Purchase details
Receipt number: 7SE558271C8462839
Merchant details
Scraped Media Pty Ltd
 
If still crashing after an specific amount try checking if there is any type of restriction in your proxy? or maybe the IP is not rotating as it should and its giving you repeated ips or try with a lower thread to avoid any issues.
 
who do i contact about not receiving the premium article scraper addon i purchased via my scrapebox?


PayPal

You paid $20.00 USD
to Scraped Media Pty LtdDetails




Paid with
VISA-2168$20.00 USDThis transaction will appear on your statement as PAYPAL *SCRAPEDMEDI
Purchase details
Receipt number: 7SE558271C8462839
Merchant details
Scraped Media Pty Ltd
http://www.scrapebox.com/contact-us
They activate it in 12 hours or less, however if there is a challenge, then they will mail the purchase email address asking for more info. So thats your primary paypal email.
 
Back
Top