1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Can Anyone Suggest a URL Downloader?

Discussion in 'Black Hat SEO' started by mrmarchuk, Feb 27, 2014.

  1. mrmarchuk

    mrmarchuk Registered Member

    Joined:
    Jun 4, 2012
    Messages:
    65
    Likes Received:
    30
    Occupation:
    Working From Home
    Location:
    Portland, OR
    So I've got ~60k URLs that I'll need to download the contents of (for scraping later, incase the web page gets removed). Can anyone suggest software that can do something like that?

    I'm hoping to download them to my hard drive so that I can scrape them in the future for data (easier).