stharthjw6j
BANNED
- Dec 23, 2013
- 584
- 251
Sorry to be a hassle Loopline but can I get an answer to this please? Scraping animated GIFs?
Permanently Closed Marketplace Sales Thread
- Thread starter Sweetfunny
- Start date
- Status
Sorry to be a hassle Loopline but can I get an answer to this please? Scraping animated GIFs?
Ok thanks, one last question from me. When scraping for all the urls on a site, is there anyway you can filter out words to cut out all the other bs. For example most emails are found on the sites contact pages... so is there anyway to make it only grab pages with contact in the url?
Thanks
- Jan 25, 2009
- 6,378
- 3,774
I don't understand the question. The image grabber scrapes animated Gifs just fine. Are you getting errors or what?
If scraping from an engine you could do like
inurl:contact
which won't work on all engines, but on google etc...
if you are working with the link extractor addon you can specify a whitelist and tell it that it must contain the word contact
stharthjw6j
BANNED
- Dec 23, 2013
- 584
- 251
Apologies, it wasn't working for some reason the first time around, I just tried it again and it worked. Thanks anyway
- Jan 25, 2009
- 6,378
- 3,774
Apologies, it wasn't working for some reason the first time around, I just tried it again and it worked. Thanks anyway
All good, glad its working for you!
- Jan 25, 2009
- 6,378
- 3,774
It crashes as in gives a popup window? You could try downloading a fresh copy just to make sure you don't have something messed up there. Unzip it to a folder on your desktop or in your documents folder.
Are you running any anti virus/security software?
You can download scrapebox from here:
http://www.scrapebox.com/payment-received
If you get a popup click on close (not send report) and then there will be a bugreport.txt saved to in your scrapebox folder. Mail that file to
scrapeboxhelp (at} gmail [dot) com
or
support (at] scrapebox {dot) com
CrazyTeen
Regular Member
- Jun 8, 2012
- 477
- 130
I have sent the bug report file to the above address and Its been two days, I havent had any replies from it.
Still i have the same problem and cant use any addons.
- Jan 25, 2009
- 6,378
- 3,774
If I were a betting man I would bet that scrapebox can't write to the addons folder. Which would mean that the addons folder does not have write permissions. So you would either need to set it to have write permissions or try downloading a fresh copy of scrapebox and then unzip it to your documents folder.
What version of windows are you running?
Check your spam folder, support always responds in 24 hours or less.
You can download scrapebox from here:
http://www.scrapebox.com/payment-received
CrazyTeen
Regular Member
- Jun 8, 2012
- 477
- 130
I have tried to Downloading a Fresh Copy but still have the same problem.
I have tried deleting the file "[FONT="]addons.mnu[/FONT]" and ran the scrapebox as said in the SB Support Email. Now i can download the addons, but when i run the Link Extractor Addon, it runs for few minutes and then crashes.
I cant change the Read-Only Attribute of any of those Folders even though i have Full Admin Rights. So i have tried running the SB from C:\ Drive and Downloads Folder, but still it crashes.
I am using Windows 2008 RT Enterprise Version on 8GB RAM and 4 Core Dedi.
- Jan 25, 2009
- 6,378
- 3,774
Well running them from the c:\ drive or downloads folder is probably the two worst possible places to run them, save C:\windows
Try desktop or documents folder. You may need to right click on the scrapebox folder, go to properties, then I think its "security" tab and edit the users. Put your username in the box, hit check names, then click ok and then set that to full control. Just like if you were trying to make edits to the hosts file etc...
As for the link extractor, does it give a popup error? If you go to your scrapebox folder >> addons folder - there should be a bugreport.txt - you can mail that back to support and they can help you out.
whats the Problem with google Harvesting? after harvest 3k-4k it will not harvest any url.How can i solve this issue,I have 20 us Private proxy and all are fast.Is there any wrong with my Scrapebox setting?
I have set 3 connection for google harvest and i have 30 sec timeout,I was change this setting also,But google don't harvest no more than 3000-4000 url,Why?? whats the correct setting for 20 private proxy?
Please let me know As Soon As possible.
I have set 3 connection for google harvest and i have 30 sec timeout,I was change this setting also,But google don't harvest no more than 3000-4000 url,Why?? whats the correct setting for 20 private proxy?
Please let me know As Soon As possible.
faltu
Regular Member
- Dec 17, 2008
- 234
- 36
I m stuck harvesting from Bing. Both Google and Yahoo completed but Bing found around 20k plus results and its still showing that its harvesting but nothing moves. Bandwidth, URLs are all stopped. If i press stop harvesting it still doesnt stop and i have to end the process in order to stop it.
This has happened all the times in the recent weeks i ignored it as the harvested URLs are saved. But its getting annoying.
Any help?
Also some of the harvested URLs have this added at the end /RK=0 which gives a page not found error.
This has happened all the times in the recent weeks i ignored it as the harvested URLs are saved. But its getting annoying.
Any help?
Also some of the harvested URLs have this added at the end /RK=0 which gives a page not found error.
Last edited:
- Jan 25, 2009
- 6,378
- 3,774
A socket error occurs generally when something forcibly closes the connection, it could be a firewall, bad proxies etc.
Firstly try it with and without proxies. Addons only pull proxy data from scrapebox on startup, so if the use proxies box is checked or unchecked on startup and any proxies loaded, will only be refreshed in the addon if the addon is restarted. So try unchecking the use proxies box and restart the addon, does it still happen?
If so then it's probably something firewall or antivirus related.
Its basically process of elimination. If it happens without proxies its probably local, if it happens only with proxies, then its probably a proxy issue.
src:http://scrapeboxfaq.com/what-does-socket-error-mean-in-an-addon
Try 1 connection, 3 is too many and your ips are being banned.
Yes, you could do that, or ideally
do a site:domain.com
to get started, that will pull a bunch of the internal pages, then you can do the link extractor on internal, and them keep loading the results back in and pulling internal links. Also you can use the sitemap scraper addon if there is a sitemap.
Its a known issue that bing locks up sometimes on some setups in the multi threaded harvester. If you want to use bing then use the custom harvester, there is no issue there. Also the custom harvester has multiple advantages, such as 20+ engines it can scrape from and in your other case the ability to download a new engines file. So scrapebox can update the file and you can download it when an engine changes something and it causes something like your /RK=0 to append to urls. Else with the multi harvester its hard coded and you have to wait for a update of scrapebox. Video I did on that:
Last edited by a moderator:
faltu
Regular Member
- Dec 17, 2008
- 234
- 36
Ok i have downloaded the new engines file as suggested from custom harvester. And i can see the settings for yahoo have been updated with RK=0. I will have to use custom harvester from now on. Thanks for that info
Last edited by a moderator:
SMDStudios
Junior Member
- Dec 9, 2013
- 187
- 43
Having an issue with Scrapebox here....I stopped using for about 2 months then came back and with over 4k proxies during a harvest its not reusing the them. From what I can tell it uses them once and then ends harvesting. Worked fine previously but whatever happened something changed. HELP?
- Jan 25, 2009
- 6,378
- 3,774
Your welcome. I think yahoo is fixed for the multi harvester in the next version of scrapebox, but there still is some things they need to do before they can release it. Anyway the custom harvester is much more powerful.
Scrapebox will keep randomly picking them and using them until harvesting is finished. However you can change the proxy retries. That controls how many times a keyword is retried with a different random proxy before it is skipped. If your using the multi threaded harvester then its under settings >> adjust multi threaded harvester proxy retries.
If your using the custom harvester then its under settings >> custom harvester settings
- Status