how to download all pages

Discussion in 'BlackHat Lounge' started by Bartman, Jan 12, 2011.

  1. Bartman

    Bartman Power Member

    Apr 24, 2010
    Likes Received:
    hi guys
    i have a need for a efficient and fast way of doing the following:

    I have a list of many different URLs. These URLs are all from the same domain.
    when you go to each of these URLs, you will see between 5-10 links on the page. if you click on any one these links, it will take you to a .htm page.

    I need to download all of these .htm pages.
    so if I were to do it by hand, i would go to URL1, click on link one, save page as. press back. click on link 2, save page as. back. click on link 3, save page as.
    Once URL1 is done, I do the same with URL2, URL3, etc.

    one last requirement: I cannot show the site owner my ip address. so proxies?

    any ideas guys?
  2. shehzada4

    shehzada4 Regular Member

    Sep 12, 2010
    Likes Received:
    174 comes with a full powered website download manager that lets the users decide which web pages and files should be downloaded and this manager can also download your .htm pages