1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Which Software Will Spider A Site To Show All It's Web Pages

Discussion in 'Black Hat SEO Tools' started by meakerseeker, Jan 5, 2011.

  1. meakerseeker

    meakerseeker Regular Member

    Joined:
    Jan 3, 2010
    Messages:
    385
    Likes Received:
    23
    I'm trying to find a software program that will spider a site and
    report back all the web pages that's on a site & if possible create
    a index of them which software will do this.
     
  2. Cloaks

    Cloaks Regular Member

    Joined:
    Mar 20, 2010
    Messages:
    298
    Likes Received:
    90
    Burp Suite. It's a penetration testing tool, but it'll do what you need. There's a free copy to be downloaded, just search for it on Google.
     
  3. roberteb

    roberteb Regular Member

    Joined:
    Oct 30, 2010
    Messages:
    402
    Likes Received:
    120
    Location:
    UK
    Xenu will do what you want and it's free :)
     
  4. meakerseeker

    meakerseeker Regular Member

    Joined:
    Jan 3, 2010
    Messages:
    385
    Likes Received:
    23
    I downloaded it thanks, there's also OutWit Hub for firefox I'm checking out.