Hrefer vs Scrapebox
- Thread starter zee007
- Start date
Kazi_Haque
Regular Member
- Aug 13, 2010
- 325
- 429
Xrumer is the king of links and Hrefer is the king of harvesting.
Scrapebox is no where close to what Hrefer can do.
Scrapebox is no where close to what Hrefer can do.
Black Seagull
Junior Member
- Aug 28, 2012
- 105
- 36
I prefer Scrapebox, it works better for me than Hrefer. But Xrumer's Database Analyzer is much faster than Scrapebox Link Checker. Every software has its pros and cons.
allenpaul123
Regular Member
- Mar 29, 2011
- 209
- 71
Scrapebox works best for me...
- Jul 13, 2008
- 2,219
- 5,431
The next version of ScrapeBox has an additional custom harvester:
Settings:
Harvester:
So you can train it to harvest from virtually any website with a search engine. Also it can harvest and test proxies, then refresh them every X minutes while harvesting. The original harvester hasn't changed if you still want to use it, you can switch between them in the settings.
Settings:
Harvester:
So you can train it to harvest from virtually any website with a search engine. Also it can harvest and test proxies, then refresh them every X minutes while harvesting. The original harvester hasn't changed if you still want to use it, you can switch between them in the settings.
- Jan 25, 2009
- 6,378
- 3,774
I use xrumer a lot for link building, as its captcha breaking is excellent, however I never use hrefer. I have used it before, but IMHO its inferior to scrapebox when it comes to scraping. It lacks the flexibility to do the things I need it to do.
Scrapebox is designed with a general intent in mind and lets the user direct it. Where as Hrefer is designed with a specific intent in mind. Which is fine, for what its meant to do, its functional, but it just doesn't work well or at all when you try to make it work outside those realms. Scrapebox, for scraping, offers more custom direction.
theseogeek
Newbie
- Jul 20, 2011
- 12
- 3
Guys
Are there any instructions on how to use this part of scrapebox - I think it is what I am after.
I have 15000 sites that I am trying to scrape inner pages from with G and it gets only 10% through and stops...
Any help would be much appreciated
Thanks in advance guys
- Jan 25, 2009
- 6,378
- 3,774
Ill do up a vid on the new harvester, but its pretty basic. You just go to settings and tick off to "Use Custom Harvester" and then it will use it when you click harvest.
However its not going to solve your google problem. Google is quitting because its blocking the IP(s). You need to set your harvester connections to 10% of your proxies. If you have 20 proxies, set your connections to 2. Etc....
You can also do a big scrape of internal pages, and then feed them all into the link extractor and extra internal links, and then feed the results back in and extract internal links again. Do that a few times and you will have a nice internal index of pages.
theseogeek
Newbie
- Jul 20, 2011
- 12
- 3
Thanks for that reply - yeah a vid would be good.
With the link extractor I am getting 501's even tho the link is alive and well. Any ideas?
Thanks
vision2003
Junior Member
- Aug 13, 2009
- 137
- 85
Scrapebox is my cup of tea (especially with latest updates and custom scraping capability). But Hrefer will do the job aswell.
As someone who has owned Xrumer and Hrefer for a long time.. I'd have to say Hrefer is inferior to scrapebox. The reason? Out of the box.. Hrefer is SHIT. It USED to scrape fast...but now you need to spend money on a ton of proxies because google bans you within 2-3 minutes.
Just as a side note for anyone else who is considering xrumer + hrefer.. they are expensive to run.. otherwise.. your results are piss poor. This is why scrapebox destroys xrumer in terms of overall value.
Just as a side note for anyone else who is considering xrumer + hrefer.. they are expensive to run.. otherwise.. your results are piss poor. This is why scrapebox destroys xrumer in terms of overall value.
ScrapeboxWorker
Regular Member
- Jul 23, 2012
- 498
- 285
I don't know what are you talking about saying Scrapebox > Hrefer.
If you are going to do small, specific scrape - Scrapebox will help you, but you need private proxies for Google - all kind of shared and public will only make you nervous...
If you are going to collect list's for GSA/ any other link bulding tool, go for Hrefer... really, the cheaper version of Xrumer - $290 - still comes with hrefer. If you have to setup a huge scrape - scrapebox will fail with huge keyword list, scrapebox will fail with refreshing your proxies all the time. But hrefer will:
automatically refresh your proxies each X minutes
wont crash at huge keyword lists
wont fail with inurl: scrapes - even with public proxies and google!
will be 10 or more times faster than scrapebox
you can use sieve filter, example:
you want to scrape xpressengine's only, you setup a sieve filter to deny all urls not containing "document_srl" - clear results and month of scraping totally afk...
If you are going to do small, specific scrape - Scrapebox will help you, but you need private proxies for Google - all kind of shared and public will only make you nervous...
If you are going to collect list's for GSA/ any other link bulding tool, go for Hrefer... really, the cheaper version of Xrumer - $290 - still comes with hrefer. If you have to setup a huge scrape - scrapebox will fail with huge keyword list, scrapebox will fail with refreshing your proxies all the time. But hrefer will:
automatically refresh your proxies each X minutes
wont crash at huge keyword lists
wont fail with inurl: scrapes - even with public proxies and google!
will be 10 or more times faster than scrapebox
you can use sieve filter, example:
you want to scrape xpressengine's only, you setup a sieve filter to deny all urls not containing "document_srl" - clear results and month of scraping totally afk...
Scritty
Elite Member
- May 1, 2010
- 3,019
- 4,707
To be fair I don't have issues with most of the points here. I would like SB to have better proxy handling, but using the pro add-ons Sb gets over the keyword size issue - I often scrape with 150,000 keywords without much of a problem. As for failing in URL - that's a function of Google banning the proxies, not to do with the tool. Too many searches from the same IP that use specific operators like INURL or whatever gets a proxy ban. Again, with the amount of proxies I use I've not had an issue with this, but If I used less than 50 private - then yes I probably would.
Scrapebox needs better proxy handling for sure otherwise the first, third and fourth points you make can be an issue. But even with all the addons, SC comes in $200 cheaper than the cheapest Hrefer license, and that's going to affect some people's buying decision Just under 100 - to just under 300.
Be great is SB dealt nicely with No Hands Proxies - then I'd be all set.
Scritty
mindmaster
Elite Member
- Sep 16, 2010
- 5,671
- 3,112
It's hard to beat Scrapebox considering the overall functions and the price...
However for scraping I have been testing Gscraper lately and it's 5 times faster than Scrapebox.
Haven't tried Hrefer.. so I can't say anything else besides the high price tag..
If I would have to choose between Gscraper, Scrapebox and Xrumer/Hrefer, I would by myself 3 new Scrapebox licenses. Simply because Scrapebox offers so many features that I actively use.
If you are all about scraping... and just that, I am putting my money on Gscraper.
However for scraping I have been testing Gscraper lately and it's 5 times faster than Scrapebox.
Haven't tried Hrefer.. so I can't say anything else besides the high price tag..
If I would have to choose between Gscraper, Scrapebox and Xrumer/Hrefer, I would by myself 3 new Scrapebox licenses. Simply because Scrapebox offers so many features that I actively use.
If you are all about scraping... and just that, I am putting my money on Gscraper.
ScrapeboxWorker
Regular Member
- Jul 23, 2012
- 498
- 285
Of course you need Scrapebox, yes its awesome, and theres nothing like that here. I personally have Scrapebox with all the premium addons.
I also have Gscraper, have some plugins that Scrapebox doesnt. But for long (month or weeks) AFK scrapes, only Hrefer - it's totally AFK, you are saying its $300, well i love the time it saved me from clicking "Export All not completed keyword's" and retesting proxies again"
It's also in the way that tool scrape's. Here, scraping with public proxies (i save all ALIVE proxie's, i dont check them for annonymous one's).
Only 150 threads in hrefer (easy can handle 1000). 3888 proxies alive. Inurl: scrape. Parsing time 2 hour's. Removing duplicate urls when it scrapes, filtering url that you dont need when it scrapes - saving TONS of time, dont tell me its not worth it.
I also have Gscraper, have some plugins that Scrapebox doesnt. But for long (month or weeks) AFK scrapes, only Hrefer - it's totally AFK, you are saying its $300, well i love the time it saved me from clicking "Export All not completed keyword's" and retesting proxies again"
It's also in the way that tool scrape's. Here, scraping with public proxies (i save all ALIVE proxie's, i dont check them for annonymous one's).
Only 150 threads in hrefer (easy can handle 1000). 3888 proxies alive. Inurl: scrape. Parsing time 2 hour's. Removing duplicate urls when it scrapes, filtering url that you dont need when it scrapes - saving TONS of time, dont tell me its not worth it.
Attachments
Last edited: