I want to build a site which checks for news updates on a series of sites, and structures any updates made.
What are some good tools for webscraping / spidering
I have seen sphider and scrapybut was curious of others. I am wanting to structure the data so that it can then be used for analysis rather than just straight scraping.
Also what are some good RSS to SQL importers?
cheers!
What are some good tools for webscraping / spidering
I have seen sphider and scrapybut was curious of others. I am wanting to structure the data so that it can then be used for analysis rather than just straight scraping.
Also what are some good RSS to SQL importers?
cheers!