1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

URL Scraper - Try This!!!

Discussion in 'Black Hat SEO Tools' started by simplyrahul, Oct 30, 2009.

  1. simplyrahul

    simplyrahul Registered Member

    Joined:
    Jun 17, 2008
    Messages:
    90
    Likes Received:
    15
    I have seen many people looking for URL scraper / harvester

    Try this: http://cpvtools.com/

    Its Free!!

    :):)
     
    • Thanks Thanks x 7
  2. JBatman

    JBatman Registered Member

    Joined:
    Mar 31, 2009
    Messages:
    64
    Likes Received:
    17
    Location:
    Indiana
    Home Page:
    just tried this out, works pretty well
     
  3. SpamHat

    SpamHat Junior Member Premium Member

    Joined:
    Apr 27, 2009
    Messages:
    151
    Likes Received:
    67
    Location:
    UK
    Try this one as well - no limits and all client side so you keep your keywords safe:

    http://gScrape.com
     
  4. peter2002

    peter2002 Senior Member

    Joined:
    Jul 8, 2009
    Messages:
    1,120
    Likes Received:
    24,314
    Occupation:
    Internet Marketer, Degrees in Business and Psychol
    Location:
    USA
    They both work well. Thanks for sharing.
     
  5. TokwatBaboy

    TokwatBaboy Newbie

    Joined:
    Oct 22, 2009
    Messages:
    4
    Likes Received:
    0
    I was trying to sign up on the first post's url but i get an error. Oh well, it's free anyway.
     
  6. Sweetfunny

    Sweetfunny Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 13, 2008
    Messages:
    1,747
    Likes Received:
    5,039
    Location:
    ScrapeBox v2.0
    Home Page:
    The trouble with server based scrapers is as soon as you get more than a few visitors per hour using it the server IP gets blocked from Google and it stops working.

    Have a search on Google, there's a few free PHP snippets floating around you can upload to your server like these sites but without the fancy interface. With only you using it, it will last a lot longer.
     
  7. SpamHat

    SpamHat Junior Member Premium Member

    Joined:
    Apr 27, 2009
    Messages:
    151
    Likes Received:
    67
    Location:
    UK
    ^^ That's the thing with gScrape - it's NOT a server based scraper and it NEVER gets banned.

    I know the problem of getting the IP's blocked when doing it server side so that's why I made gScrape.

    It all runs CLIENT SIDE and doesn't get banned because of the way it's built.
     
    • Thanks Thanks x 6
  8. boffmaster

    boffmaster Junior Member

    Joined:
    Jun 1, 2009
    Messages:
    144
    Likes Received:
    32
    I have hrefer, url harvester and url scraper.
    I like url scraper the best as it has proxy support, accepts complicated search queries, uses 4 search engines, has a scheduler, puts potential follow links in a separate file, and also gives you the page rank of the site as well as the page rank of the page it finds. There are also a bunch of how-to videos on the website. hrefer is also very good and comes with xrumer. Together they make a potent combination. Anyway, I don't think url harvester is supported anymore so here are the links to hrefer and url scraper.

    http://urlscraper.com
    http://botmasternet.com

    Hope that helps a bit
     
  9. Dan_B

    Dan_B Junior Member

    Joined:
    Aug 21, 2009
    Messages:
    161
    Likes Received:
    48
    Location:
    Toronto
    kinda of a noob question... but what is the purpose of scraping these links?
     
  10. Sweetfunny

    Sweetfunny Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 13, 2008
    Messages:
    1,747
    Likes Received:
    5,039
    Location:
    ScrapeBox v2.0
    Home Page:
    Finally! Someone who's done it right, every web based harvester i've seen handles it server side and collapses when traffic exceedes about 5 visitors per hour. Good job.

    Spam, Research, Gathering Competitors Backlinks.. Tons of reasons really, it beats copying and pasting them out of Google one by one that's for sure.
     
  11. TheMatrix

    TheMatrix BANNED BANNED

    Joined:
    Dec 20, 2008
    Messages:
    3,444
    Likes Received:
    7,279
    Thanks..Works perfectly!!
     
  12. anwar001

    anwar001 Registered Member

    Joined:
    Apr 23, 2008
    Messages:
    84
    Likes Received:
    20
    Sorry, but may I know what exactly is a url scraper?
     
  13. TheMatrix

    TheMatrix BANNED BANNED

    Joined:
    Dec 20, 2008
    Messages:
    3,444
    Likes Received:
    7,279
    ^^It is a small white text box on the top left corner of BHW. Sometimes, it is also referred to as "google".
     
    • Thanks Thanks x 1
  14. SpamHat

    SpamHat Junior Member Premium Member

    Joined:
    Apr 27, 2009
    Messages:
    151
    Likes Received:
    67
    Location:
    UK
    A url scraper is a tool that collects all the URLs that a search engine would return for a given keyword - often for all the pages 1-10.

    You then enter this url list into various tools that get you links from each of the urls.

    If you wanted, say 10,000 urls getting them by hand would be close to impossible - so we use url scrapers.
     
  15. simplyrahul

    simplyrahul Registered Member

    Joined:
    Jun 17, 2008
    Messages:
    90
    Likes Received:
    15
    Your username contains the word techie...thats hilarious..go read one of those dummies book out there...LMAO
     
  16. youngguy

    youngguy Senior Member

    Joined:
    Apr 11, 2009
    Messages:
    1,053
    Likes Received:
    1,560
    Location:
    Hell
    @SpamHat: I'm curious how you can get data from cross-domain (google.com) with javascript? I will have to figure it out! Thanks alot! Nice Job spam hat!
     
  17. reality49

    reality49 Newbie

    Joined:
    Nov 11, 2009
    Messages:
    2
    Likes Received:
    0
    Thanks for the shere
     
  18. backtobasics

    backtobasics Jr. VIP Jr. VIP

    Joined:
    Nov 10, 2009
    Messages:
    118
    Likes Received:
    45
    Ok, I'm new here and starting to learn about BH techniques. Can you give me a hint or point me to a thread that discuses some of those tools? I have no idea what to even search on.

    I'm in the same boat as another forum member a few posts up when he asked the purpose of a URL scraper.

    Looking to learn and earn. I'm a sponge, teach me. ;)

    Thanks for any and all guidance!
     
  19. abrehong

    abrehong Newbie

    Joined:
    Nov 13, 2009
    Messages:
    16
    Likes Received:
    1
    Location:
    USA
    Home Page:
    cpvtools.com look good toll (free)
     
  20. futuremills

    futuremills Regular Member

    Joined:
    Nov 19, 2009
    Messages:
    358
    Likes Received:
    62
    these seem to be down