So I've got ~60k URLs that I'll need to download the contents of (for scraping later, incase the web page gets removed). Can anyone suggest software that can do something like that?
I'm hoping to download them to my hard drive so that I can scrape them in the future for data (easier).
I'm hoping to download them to my hard drive so that I can scrape them in the future for data (easier).