1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Need a complete site scraper, stat!

Discussion in 'Black Hat SEO Tools' started by dirtbag, Feb 19, 2012.

  1. Feb 19, 2012
    #1
    dirtbag

    dirtbag Senior Member

    Joined:
    Jul 24, 2008
    Messages:
    990
    Likes Received:
    527
    What's a good app for grabbing everything on a page? And I mean everything. I need the entire site structure scraped, and the images, all the pages, all of it.
     
  2. Feb 19, 2012
    #2
    chipmunk951

    chipmunk951 Senior Member

    Joined:
    May 10, 2010
    Messages:
    1,013
    Likes Received:
    444
    Occupation:
    IM
    Location:
    Zimbabwe
    try Using HTTrack
     
    • Thanks Thanks x 1
  3. Feb 19, 2012
    #3
    christoss1959

    christoss1959 Senior Member

    Joined:
    Nov 25, 2010
    Messages:
    894
    Likes Received:
    1,152
    Home Page:
    Yes HTTrack can do this and it's free
     
  4. Feb 19, 2012
    #4
    washington2010

    washington2010 Regular Member

    Joined:
    Apr 1, 2011
    Messages:
    331
    Likes Received:
    44
    wget works
     
  5. Feb 19, 2012
    #5
    dirtbag

    dirtbag Senior Member

    Joined:
    Jul 24, 2008
    Messages:
    990
    Likes Received:
    527
    HTTrack did an excellent job
     
  6. Feb 20, 2012
    #6
    rezident

    rezident Newbie

    Joined:
    Feb 13, 2012
    Messages:
    13
    Likes Received:
    2
    I prefer wget for this task, its open source and easy to use