I want to build a site which checks for news updates on a series of sites, and structures any updates made. What are some good tools for webscraping / spidering I have seen sphider and scrapybut was curious of others. I am wanting to structure the data so that it can then be used for analysis rather than just straight scraping. Also what are some good RSS to SQL importers? cheers!