Can using Scrapebox get you in trouble with isp ?

I just bought Scrapebox yesterday. And loaded it with 5000 keywords and managed to scrape 140,000 urls from bing.

today when i try again using the exact settings, same custom harvester it freezes the window, even if it reaches 100% harvest it just doesnt want to end and remains frozen.

and while thats happening the cpu sometimes goes to 98% load and stays there forever.

the only way to end it is by the taskmanager.

Iam new to all this as iam a plumber by trade. But my worry is that , is this happening because i am abusing my 3Mbps crappy british broadband.

i have also tweaked the TCP optimiser by following another thread to see if it resolves the problem , sadly its still the same.

i also reduced the connections to 5 and still no joy.

i re-downloaded scrapebox again, still no hope

Any suggestions will be much appreciated

Im not familiar with British inet, but by the standard of most countries you won't get into trouble for scraping data. However if you are posting links/contact forms then you will want to use some private proxies. If you have metered internet then you want to take that into account, but scraping google is highly optimized, and google is already highly optimized so it should be fine. Bing is also quite optimized.

Your freezing is because 1 or more of the threads are frozen, this can be from anti-virus, malware checkers, firewalls, pc optimization software, skype, utorrent, the list goes on.

So whitelist scrapebox in all security software and then try closing down any uneeded programs.

The good news is all results are saved in near real time in the harvester_session folder, which is in your main scrapebox folder, so they are not lost.

Bascially anything can lock a thread, so you just have to do some trial and error to sort that. Also you can try to go to settings >> connections timeouts and other settings >> more harvester options >> harvester min threads. Set this to like 20%. You can experiment and try higher/lower as well. When your connections get down to the percent specified, scrapebox will try and auto kill the remaining connections. So 20% at 5 connections means when it gets down to only 1 connection left scrapebox will try and auto kill it. So maybe 40% if your only using 5 connections.

Hello Loopline

Thank you for the detailed reply. i reduced the harvester min threads, and currenly testing at 50% . will keep reducing until it's stable.

in the mean time i downloaded Process Explorer and taken a screenshot of the threads while scrapebox is running.

Could you please kindly view the picture and let me know if there are any obvious abnormalities.

Thank you

try an use good proxies cos in no distant time the ip you are present using will be banned.

cyrax1010 said:

Hello Loopline

Thank you for the detailed reply. i reduced the harvester min threads, and currenly testing at 50% . will keep reducing until it's stable.

in the mean time i downloaded Process Explorer and taken a screenshot of the threads while scrapebox is running.

Could you please kindly view the picture and let me know if there are any obvious abnormalities.

Thank you

Click to expand...

I don't see a picture.