1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Crawl Website's to Harvest Links? Software?

Discussion in 'Black Hat SEO' started by myworldplz, Jun 20, 2009.

  1. myworldplz

    myworldplz Newbie

    Joined:
    May 23, 2009
    Messages:
    8
    Likes Received:
    0
    Hey I need a bit of software it needs to harvest links from a website and crawl for more, or just extract all links from current page.

    I've looked for two hours and have found nothing and spent an hour un-infecting myself from an HTML Exploit -.- from trying to find the software.

    Some help would be nice, does anything exist of this sort? I'm using it to build a search engine for free websites and I'll use that to get revenue from CPA Networks.

    Again thanks to anyone who helps :)!

    Love to give back to the community aswell got some great software to share :D
     
  2. Scrumdidlyumptious

    Scrumdidlyumptious Newbie

    Joined:
    May 27, 2008
    Messages:
    6
    Likes Received:
    1
    HRefer is what you are looking for, plus a private proxy list.
     
  3. myworldplz

    myworldplz Newbie

    Joined:
    May 23, 2009
    Messages:
    8
    Likes Received:
    0
    Where can I aquire a cracked copy of such? :) I mean so I can test it..*wink*
     
  4. myworldplz

    myworldplz Newbie

    Joined:
    May 23, 2009
    Messages:
    8
    Likes Received:
    0
    Ok I'm confused all I want is something to collect urls from sites and put them into a text file so my search engine can have them for my index. Not sure how hrefer works?
     
  5. GoogleBling

    GoogleBling Registered Member

    Joined:
    Jan 28, 2009
    Messages:
    94
    Likes Received:
    9
    Web Data extractor - this harvests links then follows.

    side note: web data extractor + zango = Boom lots of money (cats out the bag now)
     
  6. myworldplz

    myworldplz Newbie

    Joined:
    May 23, 2009
    Messages:
    8
    Likes Received:
    0
    Well I have the software to create the search engine and such already I just needed the links, I do not think it is beyond my competence.
     
  7. indexyoursite

    indexyoursite Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 19, 2008
    Messages:
    262
    Likes Received:
    219
    Occupation:
    Day Job: Latin Lover
    Location:
    I´ll check my GPS & tell you
    Visual Web Spider, is easy and will do the job
     
  8. Ueland

    Ueland Registered Member

    Joined:
    May 4, 2009
    Messages:
    97
    Likes Received:
    40
    What exactly are you trying todo, create a search engine? (Or just set up a search engine script and "destroy Google"?)
     
  9. myworldplz

    myworldplz Newbie

    Joined:
    May 23, 2009
    Messages:
    8
    Likes Received:
    0
    Setup a search engine script for a web network that lacks such a thing (webs.com)
     
  10. highbids

    highbids Regular Member

    Joined:
    Jan 19, 2008
    Messages:
    229
    Likes Received:
    3
    Where can we get Visual Web Spider