pelangi
Regular Member
- Jul 30, 2016
- 218
- 37
no error message, it seems sb didnt get anything to scrape, even in max level mode (25).
Permanently Closed Marketplace Sales Thread
- Thread starter Sweetfunny
- Start date
- Status
- Jan 25, 2009
- 6,378
- 3,774
Well it seems to me forbes is broke or money hungry. When you visit them in a browser they toss up that stupid ad page.
So the expired finder is loading forbes.com
Which 302 the expired finder to
http://www.forbes.com/forbes/welcome/?/&toURL=http://www.forbes.com/&refURL=&referrer=
Which then is the ad page so forbes can force you into an ad before they let you into the site. The only link on the page seems to be a link to the page that forbes is so kind to give you instructions on how to turn off any adblockers so they can be sure to squeeze all the money out of you they can
http://www.forbes.com/adblock/instructions/
From there its a dead end.
Even if you toss in a deep link to start like
http://www.forbes.com/sites/antoine...hstar-and-colony-capital-merger/#1e17a6117c6f
it will redirect you to the splash page.
Then it has a timer before you can click continue, but the expired finder isn't build to deal with a timer, it just wants to load any links on the page.
Further even if it delayed forbes seems to heavily rely on javascript with no NoJS alternative so Im not sure it would work anyway.
Joseph Lich
BANNED
- Nov 25, 2015
- 401
- 79
Are saved javascript content safe? I worry some thieves will trying to sqeezing into my PC.
Last edited:
pelangi
Regular Member
- Jul 30, 2016
- 218
- 37
just like what i figurd out. thnks for clarifyin
can i know what is this for??
Stephen Kurt
BANNED
- Jan 15, 2016
- 50
- 10
One of my various testing.
Just did another test, saving an image to local disk, but I can't open it.
pelangi
Regular Member
- Jul 30, 2016
- 218
- 37
replied by another account?
oh, i didnt understand. test what?
uh, whatever, nevrmind about it..
- Jan 25, 2009
- 6,378
- 3,774
It seems that your trying to download an image with the custom data grabber, which will not work. It only picks up "text" or content using before or after markers or regex. It doesn't actually download the content of the text that it scrapes, nor would it execute it if it was javascript or something. Basically the custom data grabber could be ultra simplified to say it look as the html source of the page can copies what you want and pastes it to notepad. Its more complex then that, but if that helps.
So the sources doesn't show images nor would notepad.
However your in luck, all you need to do is go to grab/check >> grab images from harvested url list. Scrapebox has taken the time to prebuild a image downloading tool for you.
Joseph Lich was asking a question unrelated to Scrapebox. He wants to know if he saves javascript to his pc can someone remotely launch it and then gain access to his pc.
Stephen Kurt quoted him, but it was unrelated, so perhaps an accidental quote.
Thats my take anyway.
Stephen Kurt
BANNED
- Jan 15, 2016
- 50
- 10
There's indeed a grab images from harvested url list tool! So many prebuilt, if not use often after several months almost forgot them. I am old now.It seems that your trying to download an image with the custom data grabber, which will not work. It only picks up "text" or content using before or after markers or regex. It doesn't actually download the content of the text that it scrapes, nor would it execute it if it was javascript or something. Basically the custom data grabber could be ultra simplified to say it look as the html source of the page can copies what you want and pastes it to notepad. Its more complex then that, but if that helps.
So the sources doesn't show images nor would notepad.
However your in luck, all you need to do is go to grab/check >> grab images from harvested url list. Scrapebox has taken the time to prebuild a image downloading tool for you.
Joseph Lich was asking a question unrelated to Scrapebox. He wants to know if he saves javascript to his pc can someone remotely launch it and then gain access to his pc.
Stephen Kurt quoted him, but it was unrelated, so perhaps an accidental quote.
Thats my take anyway.
Stephen Kurt
BANNED
- Jan 15, 2016
- 50
- 10
For example, if has
Code:
eval(function(p,a,c,k,e,r){e=function....It looks very familar.
JiveTurkeySammich
Regular Member
- Apr 6, 2014
- 288
- 48
Just wanted to say how f'n Awesome Scrapebox is!! Most of my posts are questions, but I dont know what I would do without this software. Our application requires a lot of data, so we almost contracted with a well known data supplier that supplies Apple and other larger companies. They wanted $1000/month per country to access their api, which was limited by requests as well. I looked at the data and was wondering if scrapebox could grab that.. Hell yeah it can. We will have even better data than what was in their database.
Cheers Mates!!
Cheers Mates!!
- Jan 25, 2009
- 6,378
- 3,774
lolThere's indeed a grab images from harvested url list tool! So many prebuilt, if not use often after several months almost forgot them. I am old now.
Indeed Ive talked to other people that are saving a mint just from scraping data over buying it. Its amazing.
Joseph Lich
BANNED
- Nov 25, 2015
- 401
- 79
Loopine can I know the probable details of internal mechanisms when harvest engines parsing urls? I am not a perfectism but forgive my ignorance, if this part can be improved,it would become more reasonable. I don't want to write this in public but as a loyalty user, I think it's the responsibility to point out this.
What referring to is "Must not be in link:" of Harvest Engine Configuration. When custom a search engine, this option is needed(maybe). But the default ones, (I noticed bing), not matter how config
"Must not be in link" there are still some "additional" links be harvested. Of cource I have a method only harvest links which are exactly wanted (on bing.com)...
What referring to is "Must not be in link:" of Harvest Engine Configuration. When custom a search engine, this option is needed(maybe). But the default ones, (I noticed bing), not matter how config
"Must not be in link" there are still some "additional" links be harvested. Of cource I have a method only harvest links which are exactly wanted (on bing.com)...
Last edited:
Joseph Lich
BANNED
- Nov 25, 2015
- 401
- 79
First item of 2.0.0.74 ChangeLog. Minimize the Main GUI from desktop when running.
- Jan 25, 2009
- 6,378
- 3,774
So your saying its harvesting links that match whats in the must not be in link field?
Can you give some example urls that are harvested, and show what you have in the must not be removed section? Also if you happen to have a keyword that reproduces this that would be great.
As Mr. Lich noted, if your using the latest version of Scrapebox and the automator then when the automator is running - in the lower left hand corner of the automator window is a button labeled "hide". Just click that and it gets minimized.
FutureProofSeo
Senior Member
- Jul 3, 2013
- 956
- 484
Is there any reason why the customer harvester would return 0 results, but the detailed harvester works as normal?
I've been using an older version for ages because updating gave me this problem, and now I can't find the old version to restore.
I've been using an older version for ages because updating gave me this problem, and now I can't find the old version to restore.
- Jan 25, 2009
- 6,378
- 3,774
Aliens are controlling your machine and spamming the inter-universe with the custom harvester.
Sorry, in a rare mood, lol
Actually there is a bug in the current version where proxies that use user/pass aren't being dealt with correctly. Proxies that are ip authenticated or when not using proxies works fine. It only affects the custom harvester, the detailed harvester is fine with all proxy types.
The current version on the website is the .74 which should be fine, but you can use the detailed harvester as its already fixed in the .77 which isn't yet released.
http://www.scrapebox.com/payment-received
More then likely the detailed harvester is better for most people using user/pass private proxies anyway, but thats why, or aliens you can pick.
onelasttime
Newbie
- Jan 22, 2016
- 40
- 2
Little problem... I updated scrapebox then an error box poped up saying it could not be opened from the folder I've always opened it from. Restarted my computer but no luck. Please help
I had the same error, move scrapebox to Desktop o documents folderLittle problem... I updated scrapebox then an error box poped up saying it could not be opened from the folder I've always opened it from. Restarted my computer but no luck. Please help
Hi @loopline, I'm trying to use the custom harvester to do searches. I'm aware that there's an issue using it that was fixed in 2.0.0.76, trouble is when I go to update my version it only goes updates to 2.0.0.75... I noticed that and tried to update again and still isn't working but now my backup of my previous version is gone and I'm stuck with only 2.0.0.75. I tried the download link you suggested but it also only gives me 2.0.0.75.
It's my first time really using ScrapeBox so there are a couple things I'm not sure about...
I'm trying to use the custom harvester and have about 4k keywords using operators like site:blogspot.com keyword. If I use User Proxies option I get a tiny amount of results and then i'm flooded with Socket 10054 errors, after about 800 errors SB crashes and I can't even submit a report using the bug report option (I fill it out but says it couldn't submit). If I try again, all I get are 10054 errors and no results. I'm only using 10 threads in the harvester. If I use my private proxies instead, I get a 503 error and no results.
I'm using AVG (free version without firewall enabled), AVG is known to 'cause issues but I'm not sure if it's because of this I've disabled it and the problem still persists and I'm not using it's firewall because it's free version so there's no rules to change.
I've tried downloading and using the Windows 7 hotfix you linked in a previous post regarding the 10054 socket errors but whenever I tried the hotfix said it wasn't applicable for my system.
I've downloaded and used the addtofwexecutable from the ScrapeBox download page to add exceptions to the Windows Firewall.
I'm trying to add exceptions to my router and it's firewall but I don't know which ports to allow, etc.
I find it weird that I'm getting some results sometimes (albeit very few, like 100-400 url's) and then other times not. Like, it's not being blocked but then it is all of a sudden. I saw a video of someone doing the exact same thing using 500 threads from 8 months ago, so I don't feel like I'm using too many eventhough I've heard Google's cracked down on things somewhat.
Any thoughts/suggestions? Would love to get this working, I've seen so many awesome things that ScrapeBox can do and I'm excited to get started but this is major roadblock.
It's my first time really using ScrapeBox so there are a couple things I'm not sure about...
I'm trying to use the custom harvester and have about 4k keywords using operators like site:blogspot.com keyword. If I use User Proxies option I get a tiny amount of results and then i'm flooded with Socket 10054 errors, after about 800 errors SB crashes and I can't even submit a report using the bug report option (I fill it out but says it couldn't submit). If I try again, all I get are 10054 errors and no results. I'm only using 10 threads in the harvester. If I use my private proxies instead, I get a 503 error and no results.
I'm using AVG (free version without firewall enabled), AVG is known to 'cause issues but I'm not sure if it's because of this I've disabled it and the problem still persists and I'm not using it's firewall because it's free version so there's no rules to change.
I've tried downloading and using the Windows 7 hotfix you linked in a previous post regarding the 10054 socket errors but whenever I tried the hotfix said it wasn't applicable for my system.
I've downloaded and used the addtofwexecutable from the ScrapeBox download page to add exceptions to the Windows Firewall.
I'm trying to add exceptions to my router and it's firewall but I don't know which ports to allow, etc.
I find it weird that I'm getting some results sometimes (albeit very few, like 100-400 url's) and then other times not. Like, it's not being blocked but then it is all of a sudden. I saw a video of someone doing the exact same thing using 500 threads from 8 months ago, so I don't feel like I'm using too many eventhough I've heard Google's cracked down on things somewhat.
Any thoughts/suggestions? Would love to get this working, I've seen so many awesome things that ScrapeBox can do and I'm excited to get started but this is major roadblock.
- Status