I am needing a scraper/rss scraper that can go to any website and scrape/put to a feed the contents of that site. I have found several that can make a rss feed from a singal page, but I would need it to do the following:
1. I would go to a specific website and search for articles using a specific keyword and the results would be similar to this
Article 1
Brief Desc
Link to Full Article
Article 2
Brief Desc
Link to Full Article
.
.
.
Article 10
Brief Desc
Link to full Article
Page 1 of 250
2. I need a program to where I can enter the the URL of the search above into it and it will either scrape or make a rss feed.
3. The kicker is I want it to follow the Links to the full articles and scrape/make a feed to them. So in the example above it would be able to pull 2500 full articles into a feed.
Similar to how WPROBOT works, but I need it to work for a specific site.
Sorry I am not very knowledgeable about this type of stuff, so any help is appreciated!!
1. I would go to a specific website and search for articles using a specific keyword and the results would be similar to this
Article 1
Brief Desc
Link to Full Article
Article 2
Brief Desc
Link to Full Article
.
.
.
Article 10
Brief Desc
Link to full Article
Page 1 of 250
2. I need a program to where I can enter the the URL of the search above into it and it will either scrape or make a rss feed.
3. The kicker is I want it to follow the Links to the full articles and scrape/make a feed to them. So in the example above it would be able to pull 2500 full articles into a feed.
Similar to how WPROBOT works, but I need it to work for a specific site.
Sorry I am not very knowledgeable about this type of stuff, so any help is appreciated!!