Does anyone else have issues with the premium article scraper? My threads just slowly dwindle and the program is completely unresponsive. The same happens if I quit or if it finishes. I just tried lowering my URLs to 25 and I extracted a total of 46 records but its still dead. I really need a fix for this if anyone has one. Thanks!
Scrapebox Premium Article Scraper Crash
- Thread starter LarryM
- Start date
- Sep 10, 2010
- 11,834
- 26,684
@Sweetfunny can you have a look please?
I know loopline does stuff with scrapebox but I dont know if he does the premium plugins. I will try with another sites links today when I get a chance. Maybe ezine just isnt liking me or my low quality scraped proxies have leaked my real IP. I do verify proxies many times for anonymity when I scrape until the only ones failing are just timing out not leaking.
- Jan 25, 2009
- 6,378
- 3,774
Its scraping google so most likley your ips are blocked. Google made some changes a few weeks ago and now they seem to be blocking ips faster.
are you using proxies or just your ip?
This is purely scraping a hand gathered list of ezine articles. At this point it would be faster to manually do it but I really would like it kind of automated. I have 331 proxies that passed the anonymous test about 10 times.
- Jan 25, 2009
- 6,378
- 3,774
Yes, but if all 331 fail the google test and/or fail for the query its using then you might as well have zero proxies.
Do they pass the google test? If so and they still don't work I can give you the exact query its using and then you can build a custom test for it and see. Google tighted it up a few weeks ago and is banning ips for various queries much faster now and there are different kinds of ips bans.
M4DM4X
Elite Member
- Jan 21, 2015
- 2,911
- 1,753
Facing quite the same issue with the Harvester tab, the tool freezes after a few seconds of scraping data and impossible to export nor do anything else but ctrl-alt-del to kill the process. I even let it run all night long hoping it would unfreeze but without any success.
My addon is up to date is there something I can do to solve this problem?
My addon is up to date is there something I can do to solve this problem?
- Jan 25, 2009
- 6,378
- 3,774
thats locked threads. most often that security software, but it can be pc optimization software or really any 3rd party app on your machine and even windows.
So I would start with add an exception for the entire scrapebox folder to all security software. But then you can also try closing any non needed programs, as anything from utorrent to skype can lock threads. Then you can turn them back on 1 by 1.
Also it could be your router, so you can whitelist scrapebox in your router.
M4DM4X
Elite Member
- Jan 21, 2015
- 2,911
- 1,753
Thanks loop for your help.
Well I lowered the urls number to 500 in the file and it seems to freeze less.
What I am doing if it freezes, since it always freezes at the same count, I relaunch it and try to stop it just before t freezes. It's not always working but that's better than nothing.
I will do what you suggest though, thanks again mate for your time you're a light in the dark for us
- Jan 25, 2009
- 6,378
- 3,774
I don't follow. It freezes on teh same keyword every time, or it freezes when the quantity of scraped urls reaches 500 or ?Thanks loop for your help.
Well I lowered the urls number to 500 in the file and it seems to freeze less.
What I am doing if it freezes, since it always freezes at the same count, I relaunch it and try to stop it just before t freezes. It's not always working but that's better than nothing.
I will do what you suggest though, thanks again mate for your time you're a light in the dark for us
It sounds like maybe security software is kicking in when a threshold is crossed.
M4DM4X
Elite Member
- Jan 21, 2015
- 2,911
- 1,753
It freezes randomly I cant find any pattern.
I am using bitdefender as an antivirus, nothing fancy. I am not comfortable enough to deactivate it while scrapping because it blocks malicious sites successfully while scrapping.
I sent some pics to the SB support so they can reproduce the issue. I will update when I have more infos so it can help others who have the same issue. Cheers
I am using bitdefender as an antivirus, nothing fancy. I am not comfortable enough to deactivate it while scrapping because it blocks malicious sites successfully while scrapping.
I sent some pics to the SB support so they can reproduce the issue. I will update when I have more infos so it can help others who have the same issue. Cheers
- Jan 25, 2009
- 6,378
- 3,774
Your harvesting from google right?
Its probably bit defender. you can add an exception for the entire scrapebox folder in all security software including bit defender.
But your not going to get an virus by connecting to google and then getting a list of urls. In fact Ive never heard of anyone ever in more then 10 years getting a virus from scrapebox. Because viruses usually execute and happen when a script is executed. Scrapebox uses raw sockets and threads and these are not even capable of executing scripts/javascript.
I run zero anti virus on my machines and basically have never. Save malware bytes for a little while, but that was due to a windows hack and nothing to do with scrapebox and windows patched it.
Im not saying don't run anti-virus, Im just telling you information and you can decide from there, but more then likley bit defender is the issue, because I can crank thru massive amounts of urls and data with no issue in all sorts of functions.
M4DM4X
Elite Member
- Jan 21, 2015
- 2,911
- 1,753
That's a good thing if we can't get malwares through scraping. I was wondering because almost each time I scrape I get notifications from my antivirus or antimalwaresbyte saying they blocked malicious threats from a website.
Concerning my problem I think it's solved now, the SB team released an update for the addon and after some tests it runs smoothly now. That's great, both of you Loopline and SB team are great people, you never fail to help us, big up to you.