Crawl Website's to Harvest Links? Software?

Discussion in 'Black Hat SEO' started by myworldplz, Jun 20, 2009.

  1. myworldplz

    myworldplz Newbie

    Joined:
    May 23, 2009
    Messages:
    8
    Likes Received:
    0
    Hey I need a bit of software it needs to harvest links from a website and crawl for more, or just extract all links from current page.

    I've looked for two hours and have found nothing and spent an hour un-infecting myself from an HTML Exploit :suspicious: from trying to find the software.

    Some help would be nice, does anything exist of this sort? I'm using it to build a search engine for free websites and I'll use that to get revenue from CPA Networks.

    Again thanks to anyone who helps :)!

    Love to give back to the community aswell got some great software to share :D
     
  2. Scrumdidlyumptious

    Scrumdidlyumptious Newbie

    Joined:
    May 27, 2008
    Messages:
    6
    Likes Received:
    1
    HRefer is what you are looking for, plus a private proxy list.
     
  3. myworldplz

    myworldplz Newbie

    Joined:
    May 23, 2009
    Messages:
    8
    Likes Received:
    0
    Where can I aquire a cracked copy of such? :) I mean so I can test it..*wink*
     
  4. myworldplz

    myworldplz Newbie

    Joined:
    May 23, 2009
    Messages:
    8
    Likes Received:
    0
    Ok I'm confused all I want is something to collect urls from sites and put them into a text file so my search engine can have them for my index. Not sure how hrefer works?
     
  5. GoogleBling

    GoogleBling Junior Member

    Joined:
    Jan 28, 2009
    Messages:
    106
    Likes Received:
    9
    Web Data extractor - this harvests links then follows.

    side note: web data extractor + zango = Boom lots of money (cats out the bag now)
     
  6. myworldplz

    myworldplz Newbie

    Joined:
    May 23, 2009
    Messages:
    8
    Likes Received:
    0
    Well I have the software to create the search engine and such already I just needed the links, I do not think it is beyond my competence.
     
  7. indexyoursite

    indexyoursite Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 19, 2008
    Messages:
    262
    Likes Received:
    219
    Occupation:
    Day Job: Latin Lover
    Location:
    I´ll check my GPS & tell you
    Visual Web Spider, is easy and will do the job
     
  8. Ueland

    Ueland Registered Member

    Joined:
    May 4, 2009
    Messages:
    97
    Likes Received:
    40
    What exactly are you trying todo, create a search engine? (Or just set up a search engine script and "destroy Google"?)
     
  9. myworldplz

    myworldplz Newbie

    Joined:
    May 23, 2009
    Messages:
    8
    Likes Received:
    0
    Setup a search engine script for a web network that lacks such a thing (webs.com)
     
  10. highbids

    highbids Regular Member

    Joined:
    Jan 19, 2008
    Messages:
    229
    Likes Received:
    3
    Where can we get Visual Web Spider