1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

A good website crawler?

Discussion in 'Black Hat SEO' started by gr33n, Feb 13, 2008.

  1. gr33n

    gr33n Jr. VIP Jr. VIP Premium Member

    Joined:
    Oct 22, 2007
    Messages:
    501
    Likes Received:
    243
    Gender:
    Male
    Location:
    Ro
    Hello ! I need a tool to crawl my website and extract all the pages and save them in a text file.I used the crawl function from bookmarking demon but doesn't work so good.
     
  2. huahua

    huahua Newbie

    Joined:
    Jan 26, 2008
    Messages:
    12
    Likes Received:
    1
    Location:
    google
    Is this tools not enough?
    hxxp://httrack.com
     
  3. voxclan

    voxclan Regular Member

    Joined:
    Feb 11, 2008
    Messages:
    267
    Likes Received:
    274
    If you are running firefox, you can get the free scrapbook extension. It's working great. Been using this for almost a year and never had a problem.

    Also, if you don't mind paying, there is a small Dreamweaver extension ( siteimport ) from webassist that is pretty useful. I bought this a couple years ago and it's also doing a great job.