Looking for a new Url Harvesting tool

scrapebox is the daddy of them all. You just need good proxies because otherwise google will ban your IP fast
Scrapebox dosent scrape I dont think they update it, I've found a workaround with GSA and .ini and must say it way better
 
If you’re looking for something newer, try SiteBulb or Screaming Frog, though they’re more focused on auditing.
 
Scrapebox dosent scrape I dont think they update it, I've found a workaround with GSA and .ini and must say it way better
It does scrape and it has been updated.

however....

you have to install the updates.... ;)

you want 2.1.0.56 at least.
 
Are you trying to harvest data / scrape from a URL ? Can you provide a little more detail about your use case?
 
Can you name some good ones
I've moved on to A-Parser, which I initially bought in 2015. At the time didn't like the workflow and so moved back to Scrapebox, but now after spending some time to play around with it more I'm fully invested, and my url harvesting has improved immensely.
 
I've moved on to A-Parser, which I initially bought in 2015. At the time didn't like the workflow and so moved back to Scrapebox, but now after spending some time to play around with it more I'm fully invested, and my url harvesting has improved immensely.
What didn't you like about A-Parser ? Just curious, what the advantages of scrapebox compared to A-Parser are
 
What didn't you like about A-Parser ? Just curious, what the advantages of scrapebox compared to A-Parser are
It's just a very different workflow to Scrapebox, and you can really tell the UX/GUI was built by a programmer :D
But A-Parser's scraping abilities are so much more robust than Scrapebox, even with the latest updates. It will just take some trial and error to get used to how it works.
 
It's just a very different workflow to Scrapebox, and you can really tell the UX/GUI was built by a programmer :D
But A-Parser's scraping abilities are so much more robust than Scrapebox, even with the latest updates. It will just take some trial and error to get used to how it works.
Got it. thanks for the insight!
 
It does scrape and it has been updated.

however....

you have to install the updates.... ;)

you want 2.1.0.56 at least.
Hi loopline I do have that version and can confirm that scrapebox is not scraping when doing a engine test I recieve this on bing and second image google I thinks theres a issue there all default
1752016512256.png
1752016416567.png
 
Hi loopline I do have that version and can confirm that scrapebox is not scraping when doing a engine test I recieve this on bing and second image google I thinks theres a issue there all default
View attachment 457448
View attachment 457446
You need to use the beta harvester.

The test is for the old harvester which no longer works and never will again because the engines changed and now require javascript. So the old harvester and the old test do not work.

just put a check mark in the box that says beta, make sure it says custom harvester and then click start harvesting. You will see the new harvester beta. just use it.

there is no way to test the engines. Just use them and they work or don't and you can click to show browser, thats the test.
 
Back
Top