same here, is there support in this thread?
Sure, look back thru the 298 pages and 3+ years of this thread, lots of support.
I'm having a problem with the link extractor add-on, I'm trying to extract user pages from a forum and it either only extracts 1 link per url (when there are 20 or more people listed on each page) or it says error 404, etc. But when I go to the url that showed an error it's completely fine in Firefox. I've tried both with and without proxies and lowering the connections as well. Why is this?
Scrapebox hands the request to load the page to windows who hands it to tcp who does its job and kicks back a reply from the server to scrapebox. If its showing 404 then its because of some issue on the pc, such as a program interring along the way, a proxy etc...
Once you load the addon it will stick with the original settings for proxies. So that means if you start it up with bad proxies and the use proxies box checked and get 404 errors and turn around and just go untick the use proxies box and/or put good proxies in, it will not know it. It uses IPC to transfer data and it only pulls that data from scrapebox on startup. So you need to make sure you close down the addon, then update proxies or untick the use proxies box and then relaunch the addon, that would be true for any addon.
Next up as for not pulling any urls, it only pulls absolute urls. If urls are relative then its not going to pull them. Such as
<a href="http://www.domain.com/page1.htm"> - this is absolute and will be scraped.
<a href="page1.htm"> - this is relative and will not be scraped.
also if the links are inside say a javascript or other unsupported elements then its not going to pull them. If you give me a couple of example urls I can tell you why its not working and whether or not it will work with said urls.
Thanks for your help but unfortunately there is no file there created during my scraping time, just some old harvesting sessions.
Maybe it saves there when harvesting sessions is done or something.
It is really annoying that "Stop harvesting" button is not working :/
When I'm clicking it it's even changing color like always but harvesting is still going.
Are you giving up to 90 seconds to stop. I assume you are, but if not then it could take up to your full timeout to release the socket and stop. Also of course any program that locks even 1 socket, such as an anti-virus program, will cause scrapebox to then effectively freeze and have to be killed by task manger. Make sure you add allow rules for scrapebox in all security programs.
Hey is there any way of using a custom range for the time span of results returned when harvesting from google?
You can't set a custom time span in scrapebox, only the predetermined time spans that are there.