Sub-scraping

superscraper

Newbie
Joined
Apr 19, 2021
Messages
22
Reaction score
7
I cannot get article scraper for Scrapebox to work no matter what I do. I have Webharvey, not sure what to do there either.

I have a search for keywords like "python" Blender Maya and want to scrape out just the Python script, which usually starts with "py" and ends with a carriage return and line break. I can easily scrape all the URL's, but what about a separate scrape of python-only script and making them all .txt files in a directory on my desktop?
 
Are you getting errors?

The custom data scraper "may" be a better choice, Im not sure, it depends on the sites.
No, no errors, it just stalls.

I want to put Scrapebox in a cloud, and I pay a lot for Linux hosting with a lot of speed and RAM. I have your Windows 64-bit version. How do I do that? Do you offer a shareware license for paid memberships with online cloud?
 
No, no errors, it just stalls.

I want to put Scrapebox in a cloud, and I pay a lot for Linux hosting with a lot of speed and RAM. I have your Windows 64-bit version. How do I do that? Do you offer a shareware license for paid memberships with online cloud?
There is no shareware license, although Im not sure I totally follow your use case there. Scrapebox requires a full version of windows or mac. So if you are running linux then you would want to put an emulator like vmware etc.. .on it and then install windows on that. It will Not work on WINE.


If its stalling that indicates locked threads. here is a copy and paste from an email from scrapebox support on locked threads, what causes them and how to resolve it.

That means that something has locked 1 or more of the threads. This can be security software such as anti-virus, malware checkers and firewalls. So you should whitelist scrapebox in all security software and then you can whitelist the entire scrapebox folder as well.

Further any program that accesses the internet can lock threads, things like skype, utorrent etc… So you can try closing down any unneeded programs. Then if its working you can turn programs back on 1 by 1 to find the culprit.

Further computer optimization software can lock threads so you can shut any such software down.

Take note that disabling security software (such as anti-virus, malware checkers and firewalls) often only stops new rules form forming, but allows existing rules to still fire. So you have to fully whitelist in the security software or uninstall the security software(as a test).

Further some security softwar requires you to whitelist in more then one place before it takes effect.

Also note that disabling a router firewall, does actually fully disable it.


Basically you have to sort out what is locking the threads, because scrapebox is forced to wait until all threads are released. On occasion it can be your operating system that does it, so you can try restarting your machine and/or lowering total connections.

One other thing to note is that this can happen with proxies that keep returning small amounts of data, it won't trigger the timeout because teh connections is still active. So try a test using no proxies or make sure you are using some quality private proxies.

Lastly if your running mac, you can try lowering the connections. Mac has terrible error handling when it comes to lots of errors stacking up quickly. So if there are too many errors stacking up too quick mac can choke, so lowering the threads fixes this. This is a non issue on windows.
 
Back
Top