Scrapebox Thread count

[LarryM]

Good morning,

Edit: Sorry about the blank post that was accidental

I just had a quick question on scrapebox. Is there a setting to make worker threads regenerate? When I start a long scrape with 50 threads it dwindles down fast. I have one now with 2 threads left and its progressing slowly. Technically this is the premium article scraper plugin but I have noticed this behavior in other areas too. Thanks for any help!

I also am having an issue with the premium article scraper where it freezes while exporting after doing about 5 of 200k. I dont know if its just too much data for my computer or if its because I am exporting to a cloud folder on my PC. I will test it more once I can get threads working so it doesn't take 4 days to scrape.

 

[BassTrackerBoats]

@loopline, can you help this guy?

 

[LarryM]

Wow imagine seeing you here Thanks for the message though.

 

[loopline]

Good morning,

Edit: Sorry about the blank post that was accidental

I just had a quick question on scrapebox. Is there a setting to make worker threads regenerate? When I start a long scrape with 50 threads it dwindles down fast. I have one now with 2 threads left and its progressing slowly. Technically this is the premium article scraper plugin but I have noticed this behavior in other areas too. Thanks for any help!

I also am having an issue with the premium article scraper where it freezes while exporting after doing about 5 of 200k. I dont know if its just too much data for my computer or if its because I am exporting to a cloud folder on my PC. I will test it more once I can get threads working so it doesn't take 4 days to scrape.

The reason it goes from 50 threads to 2 threads is that the other 48 threads were locked. This is the same thing if your using utorrent, scrapebox or any other multi threaded application. If something locks the threads then they are "stuck"

The way it works with raw sockets and threads like this is they are "locked" to windows for lack of a better simple explanation. That means windows has control over them, and scrapebox is at the mercy of windows. So if windows or some 3rd party software locks 1 or more of the threads then scrapebox must wait until they are released, and if windows never releases it then it will sit there indefinitely.

So you can add an exception for the entire scrapebox folder in all security software such as anti-virus, malware checkers, firewalls etc.. Try shutting down any pc optimization software as well.

Lastly you can try closing down any non crucial application because anything from skype to utorrent to anything else can lock threads. Then you can turn apps back on 1 by 1 till you find the culprit.

Sometimes though, windows locks threads. So you can try working with smaller lists, or less threads/connections to start with.

On the exporting, I can't really say if its your machine or the cloud drive or something like security software scanning the export or a combination of them.

Again, follow the above steps and it could solve both issues. Also try saving to a local drive and see what happens, as a test.

 

[BassTrackerBoats]

The reason it goes from 50 threads to 2 threads is that the other 48 threads were locked. This is the same thing if your using utorrent, scrapebox or any other multi threaded application. If something locks the threads then they are "stuck"

The way it works with raw sockets and threads like this is they are "locked" to windows for lack of a better simple explanation. That means windows has control over them, and scrapebox is at the mercy of windows. So if windows or some 3rd party software locks 1 or more of the threads then scrapebox must wait until they are released, and if windows never releases it then it will sit there indefinitely.

So you can add an exception for the entire scrapebox folder in all security software such as anti-virus, malware checkers, firewalls etc.. Try shutting down any pc optimization software as well.

Lastly you can try closing down any non crucial application because anything from skype to utorrent to anything else can lock threads. Then you can turn apps back on 1 by 1 till you find the culprit.

Sometimes though, windows locks threads. So you can try working with smaller lists, or less threads/connections to start with.

On the exporting, I can't really say if its your machine or the cloud drive or something like security software scanning the export or a combination of them.

Again, follow the above steps and it could solve both issues. Also try saving to a local drive and see what happens, as a test.

As usual, @loopline shares freely. Guy should get some kind of medal for all he does to help.

To see more of his SB content you can go to https://www.youtube.com/user/looplinescrapebox/videos as I am sure that will help.

 

[LarryM]

Ah it didn't even occur to me that the threads were actual cpu threads. Rip my chances of using my work laptop for overnight stuff. I beat that poor thing to death daily so that really makes sense. Thanks loopline I will try transferring to my much cleaner and faster desktop!

Yea BTB his scrapebox series was the reason I purchased it. He needs an affiliate code for it.