Web Scraping

Can anybody recommend a good web scraping product? All I really want it to do is go to any website i point it at, scrape all the links and the description that goes with the link and write it out to a file.

You are going to have a tough time finding something like that. Why? Because not all sites are coded the same. Malformed, non-valid html and flash problems just to name a few. You might want to look into screen scraping with imacros. Just do a search and you can find some info out there.