URL Scraper - Try This!!!

I was trying to sign up on the first post's url but i get an error. Oh well, it's free anyway.
 
The trouble with server based scrapers is as soon as you get more than a few visitors per hour using it the server IP gets blocked from Google and it stops working.

Have a search on Google, there's a few free PHP snippets floating around you can upload to your server like these sites but without the fancy interface. With only you using it, it will last a lot longer.
 
^^ That's the thing with gScrape - it's NOT a server based scraper and it NEVER gets banned.

I know the problem of getting the IP's blocked when doing it server side so that's why I made gScrape.

It all runs CLIENT SIDE and doesn't get banned because of the way it's built.
 
I have hrefer, url harvester and url scraper.
I like url scraper the best as it has proxy support, accepts complicated search queries, uses 4 search engines, has a scheduler, puts potential follow links in a separate file, and also gives you the page rank of the site as well as the page rank of the page it finds. There are also a bunch of how-to videos on the website. hrefer is also very good and comes with xrumer. Together they make a potent combination. Anyway, I don't think url harvester is supported anymore so here are the links to hrefer and url scraper.

http://urlscraper.com
http://botmasternet.com

Hope that helps a bit
 
kinda of a noob question... but what is the purpose of scraping these links?
 
^^ That's the thing with gScrape - it's NOT a server based scraper and it NEVER gets banned.

It all runs CLIENT SIDE and doesn't get banned because of the way it's built.

Finally! Someone who's done it right, every web based harvester i've seen handles it server side and collapses when traffic exceedes about 5 visitors per hour. Good job.

kinda of a noob question... but what is the purpose of scraping these links?

Spam, Research, Gathering Competitors Backlinks.. Tons of reasons really, it beats copying and pasting them out of Google one by one that's for sure.
 
^^It is a small white text box on the top left corner of BHW. Sometimes, it is also referred to as "google".
 
Sorry, but may I know what exactly is a url scraper?

A url scraper is a tool that collects all the URLs that a search engine would return for a given keyword - often for all the pages 1-10.

You then enter this url list into various tools that get you links from each of the urls.

If you wanted, say 10,000 urls getting them by hand would be close to impossible - so we use url scrapers.
 
^^It is a small white text box on the top left corner of BHW. Sometimes, it is also referred to as "google".

Your username contains the word techie...thats hilarious..go read one of those dummies book out there...LMAO
 
@SpamHat: I'm curious how you can get data from cross-domain (google.com) with javascript? I will have to figure it out! Thanks alot! Nice Job spam hat!
 
You then enter this url list into various tools that get you links from each of the urls.

Ok, I'm new here and starting to learn about BH techniques. Can you give me a hint or point me to a thread that discuses some of those tools? I have no idea what to even search on.

I'm in the same boat as another forum member a few posts up when he asked the purpose of a URL scraper.

Looking to learn and earn. I'm a sponge, teach me. ;)

Thanks for any and all guidance!
 
Back
Top