It just continues to harvest URL until either the proxies get blocked or the keywords finish, but it does never say getting proxies, except for the time I just start the custom harvester
Permanently Closed Marketplace Sales Thread
- Thread starter Sweetfunny
- Start date
- Status
- Jul 13, 2008
- 2,219
- 5,431
Has anyone tried the Vanity Name Checker addon? There's been tons of requests for a way to find Tumblr and other blog platforms with PageRank available for registration instead of using the Alive Checker, so i though people would be all over this.
It works with Tumblr.com, Wordpress.com, YouTube.com, BlogSpot.com, LiveJournal.com, Twitter.com, Pinterest.com, Weebly.com and Flickr.com is there some major platform you want missing?
It works with Tumblr.com, Wordpress.com, YouTube.com, BlogSpot.com, LiveJournal.com, Twitter.com, Pinterest.com, Weebly.com and Flickr.com is there some major platform you want missing?
- Mar 4, 2014
- 107
- 76
Will it run properly through Wine?
- Jan 25, 2009
- 6,378
- 3,774
No, WINE lacks multiple necessary windows components to run scrapebox.
No, paypal is the only option, or you can use a credit card, but paypal is used as the payment processor. Else you can have a friend that has paypal buy it for you and scrapebox support can transfer it to your name.
prab1996
Elite Member
- Jan 8, 2013
- 3,492
- 2,044
that is a really cool feature.
i am using it and it works great for blogspot. (i check big list every day , can you add some options so that we can sort out available)
many people not even know about this feature. (it's not even on sb site ) (+ add it to main page of bst )
-=-
- Jun 20, 2013
- 11,507
- 8,912
i want to search wikidot expired domains but alive checker return all dead but they are alive any solution ? i already put code 200.
- Jul 13, 2008
- 2,219
- 5,431
Thanks for the feedback, there's a page and video available here http://www.scrapebox.com/vanity-name-checker
Which options for sorting available are you after? You can export all available URL's as text, export all results as csv or xls so they can be opened and sorted/manipulated in Excel. Or you can load them in to ScrapeBox and check PageRank, remove URL's containing/not containing and use all those filters and sorting abilities.
The Alive Checker has many uses, but it's not great at checking for available accounts/domains so the Vanity Name Checker was built. It didn't have Wikidot.com but it does now, v1.0.0.1 is now uploaded and supports:
Tumblr.com
Wordpress.com
YouTube.com
BlogSpot.com
LiveJournal.com
Twitter.com
Pinterest.com
Weebly.com
Flickr.com
WikiDot.com
OverBlog.com
mindmaster
Elite Member
- Sep 16, 2010
- 5,671
- 3,112
This is an amazing addon (testing it now). You are offering this as a free addon while others are selling softwares like this for $100 (and I bet this addon is better than anything currently sold).
Thank you.
prab1996
Elite Member
- Jan 8, 2013
- 3,492
- 2,044
i tested and this was better then that tool. i still think that scrape box should be $100/year program.
- Jan 25, 2009
- 6,378
- 3,774
Arnoldforsure
Newbie
- Feb 26, 2014
- 11
- 3
If possible, I would like the index checker to have two options, check domain indexed and check url indexed. I usually get a list of urls with my backlinks, most of which are not indexed. Instead of submitting all to the indexer services, I would like to load all urls on scrapebox, check those that have domains de-indexed, and then submit the rest to indexer.
mindmaster
Elite Member
- Sep 16, 2010
- 5,671
- 3,112
If I understand your problem correctly, you can do that already with scrapebox.
Insert the long urls (page) and check if indexed.
If you need to check if the domains are indexed, Trim to Root first then check if indexed.
Cheers
- Jan 25, 2009
- 6,378
- 3,774
Yes as mindmaster said you can already do that. You can trim to root and check if that domain is indexed, then export any indexed domains.
Then load in your original list and go to import/export >> import and compare on the domain level. Then select that list of already indexed domains. All domains in the already indexed list will then be removed from the full loaded list. Leaving you with only urls on non indexed domains. Then go index those urls.
prab1996
Elite Member
- Jan 8, 2013
- 3,492
- 2,044
i am getting a problem.
i loaded 15 private proxies , connection limit = 10
then loaded 12k keywords , i was able to get 600k results in 12 hours. it said harvest complete , but it left 9k keywords as "not completed"
i not need to scrape fast , i need to scrape slow (i won't mind scraping for 10 days constantly )
other settings (i was only scraping google)
search time = 1year old
multi threaded harvester proxy retries = 20 (max)
time out for harvester = 90 seconds (max)
can anyone tell how to let it to scrape all keywords ?
(i know there are many other scrapers to scrape fast but i am in slow scraping and i can't afford to lose even one result )
(it happens to every time sb leaves 50% of keywords) (i check proxies evey time after scrape and they are google passed )
-=-
i loaded 15 private proxies , connection limit = 10
then loaded 12k keywords , i was able to get 600k results in 12 hours. it said harvest complete , but it left 9k keywords as "not completed"
i not need to scrape fast , i need to scrape slow (i won't mind scraping for 10 days constantly )
other settings (i was only scraping google)
search time = 1year old
multi threaded harvester proxy retries = 20 (max)
time out for harvester = 90 seconds (max)
can anyone tell how to let it to scrape all keywords ?
(i know there are many other scrapers to scrape fast but i am in slow scraping and i can't afford to lose even one result )
(it happens to every time sb leaves 50% of keywords) (i check proxies evey time after scrape and they are google passed )
-=-
Last edited:
Arnoldforsure
Newbie
- Feb 26, 2014
- 11
- 3
Thanks for your response. This is a lengthy process. I like the way scrapebox makes it easy to check pr. Just load urls, click on check domain or url pr, which allows you to quickly remove undesired domains from harvester. I am actually looking for something similar for index checking, trimming to root makes the process longer. I am not looking to indexed de-indexed domains, but to get rid of them and submit those urls whose main domains are indexed to the indexer service. Not sure if I have made myself clear enough.
- Jan 25, 2009
- 6,378
- 3,774
Your connections are 1000 percent too high. Put connections to 1, not 10. You want a ratio of connections vs proxies at 1:10 or 1:15+ depending on your query. So you have 15 proxies so connections should be no more then 1. 20 proxy retries will be fine, since you only have 15 proxies anyway.
Go to settings >> use multi threaded harvester - and uncheck this. Also under that same settings menu uncheck the use custom harvester. Then try and harvest, there will be a status column. What errors are you getting in the status column?
Here is a video that goes over how to do this and other troubleshooting for the harvester that might be helpful. http://youtu.be/2QaLWgTXsRo
Yes you made your self clear, and if you go reread my process and try it you will see that it will only be submitting the urls that have your links on them for indexing, not the root domain or any other domain on there.
Also I understand that this will take you an extra 2 mins a day to do, but if scrapebox goes in and adds shortcut features on everything that everyone has requested, menu items would be so long they would fall clear off the screen, and thats even if you had a 60 inch monitor. The point is, should scrapebox add such features, that are already available, to save you 2 mins, but that would bloat the software, cause possible bugs/crashes/conflicts for other users, and then cost them hours and hours and hours of support time, which in turn means hours and hours and hours less that they can develop the software, so you can save 2 mins? No.
Nothing personal, but keeping the software trim and running smoothly is more important to me then saving 2 mins. I have multiple processes that I would love shortcuts for like your saying, but thats just me. Ive seen people ask for these little short cuts a thousand times (no joke), literally the menu systems would fall clean off the screen if they were all added.
Go reread my process, it will do exactly what you want, providing you an end list that has urls that have your links on them, but that reside on domains that are not currently indexed. And it will take you less or the same time to do then to respond to this post.
Plus I don't work for scrapebox, so perhaps they will deem your addition important and add, thats up to them to decide, Im just saying that you can already do it, and it won't take long at all.
- Status