simplyrahul
Registered Member
- Jun 17, 2008
- 94
- 16
I have seen many people looking for URL scraper / harvester
Try this: http://cpvtools.com/
Its Free!!
Try this: http://cpvtools.com/
Its Free!!
URL Scraper - Try This!!!
- Thread starter simplyrahul
- Start date
SpamHat
Junior Member
- Apr 27, 2009
- 151
- 67
Try this one as well - no limits and all client side so you keep your keywords safe:
http://gScrape.com
http://gScrape.com
TokwatBaboy
Newbie
- Oct 22, 2009
- 4
- 0
I was trying to sign up on the first post's url but i get an error. Oh well, it's free anyway.
- Jul 13, 2008
- 2,219
- 5,429
The trouble with server based scrapers is as soon as you get more than a few visitors per hour using it the server IP gets blocked from Google and it stops working.
Have a search on Google, there's a few free PHP snippets floating around you can upload to your server like these sites but without the fancy interface. With only you using it, it will last a lot longer.
Have a search on Google, there's a few free PHP snippets floating around you can upload to your server like these sites but without the fancy interface. With only you using it, it will last a lot longer.
SpamHat
Junior Member
- Apr 27, 2009
- 151
- 67
^^ That's the thing with gScrape - it's NOT a server based scraper and it NEVER gets banned.
I know the problem of getting the IP's blocked when doing it server side so that's why I made gScrape.
It all runs CLIENT SIDE and doesn't get banned because of the way it's built.
I know the problem of getting the IP's blocked when doing it server side so that's why I made gScrape.
It all runs CLIENT SIDE and doesn't get banned because of the way it's built.
boffmaster
Junior Member
- Jun 1, 2009
- 144
- 32
I have hrefer, url harvester and url scraper.
I like url scraper the best as it has proxy support, accepts complicated search queries, uses 4 search engines, has a scheduler, puts potential follow links in a separate file, and also gives you the page rank of the site as well as the page rank of the page it finds. There are also a bunch of how-to videos on the website. hrefer is also very good and comes with xrumer. Together they make a potent combination. Anyway, I don't think url harvester is supported anymore so here are the links to hrefer and url scraper.
http://urlscraper.com
http://botmasternet.com
Hope that helps a bit
I like url scraper the best as it has proxy support, accepts complicated search queries, uses 4 search engines, has a scheduler, puts potential follow links in a separate file, and also gives you the page rank of the site as well as the page rank of the page it finds. There are also a bunch of how-to videos on the website. hrefer is also very good and comes with xrumer. Together they make a potent combination. Anyway, I don't think url harvester is supported anymore so here are the links to hrefer and url scraper.
http://urlscraper.com
http://botmasternet.com
Hope that helps a bit
- Jul 13, 2008
- 2,219
- 5,429
Finally! Someone who's done it right, every web based harvester i've seen handles it server side and collapses when traffic exceedes about 5 visitors per hour. Good job.
Spam, Research, Gathering Competitors Backlinks.. Tons of reasons really, it beats copying and pasting them out of Google one by one that's for sure.
SpamHat
Junior Member
- Apr 27, 2009
- 151
- 67
A url scraper is a tool that collects all the URLs that a search engine would return for a given keyword - often for all the pages 1-10.
You then enter this url list into various tools that get you links from each of the urls.
If you wanted, say 10,000 urls getting them by hand would be close to impossible - so we use url scrapers.
simplyrahul
Registered Member
- Jun 17, 2008
- 94
- 16
Your username contains the word techie...thats hilarious..go read one of those dummies book out there...LMAO
backtobasics
Junior Member
- Nov 10, 2009
- 169
- 67
Ok, I'm new here and starting to learn about BH techniques. Can you give me a hint or point me to a thread that discuses some of those tools? I have no idea what to even search on.
I'm in the same boat as another forum member a few posts up when he asked the purpose of a URL scraper.
Looking to learn and earn. I'm a sponge, teach me.
Thanks for any and all guidance!
futuremills
Regular Member
- Nov 19, 2009
- 476
- 135
these seem to be down