Help me with this task please

blackhaze

Power Member
Joined
Jan 11, 2008
Messages
661
Reaction score
168
I need help guys, i just cant find a solution for this and its beyond me why i cant find some tool which does this.


1) i have a RSS feed, and the feed can return one or more keywords.
2) i need to fetch articles in regards to this keyword
3) build site/content using the articles, preferably on Wordpress

RSS feed/keyword -----> fetch articles -----> build blog

I looked at all available wordpress RSS plugins and autobloggers, but all those (caffeinated content, feedwordpress etc.) read an RSS feed and then generate the content from what is in the feed.

My feed contains the keyword only <--- the KW in question is already scraped from a site

I need a plugin/scraper reading the keyword (which is in the feed) and working with this...and not pulling in the feed contents itself.

I was looking at yahoo pipes, dapper, feedity how to make this. I also dont understand why yahoo pipes doesn't do this. I can make a pipe in yahoo pipes with the resulting KW ...but now i need to go and fetch the articles/create content based on the keyword.

If you are familar with yahoo pipes, rssmix, rsspect, etc..etc...please give me an idea...i have a feeling there must be a way to do this or i am going nuts :)

An alternative would be

1) is there an exsiting content builder out there which can do this?
2) I code something in PHP...but its just beyond me why there is no such tool already.
 
Last edited:
well i spent the afternoon PHP coding, i guess it will result in a nice scraper / WP plugin. Think about dynamically updating sites/blogs...yummy :)
 
uhm..i guess i will hold it secret, sorry. I think it has BIG potential and to my knowledge there is no such thing, at all. I chose WP since i think its easier to make a plugin and get a solid looking site at the end...instead of using some simpler site-builder.

Also...i didnt need to use pipes...but using pipes or dapper would be a good idea if you scrape something and dont want YOUR IP being banned...eg. if you scrape certain google sites. (Which is ironic, since G has LOTS of sites which themselves are scraping..eg. from Wikipedia.)

If you go through a pipe then...its not your IP..so this would reduce risk of temp IP bans.

I fvcking love WP and messing around with the plugins and developing my own..fun stuff there.
 
well, i do the same thing, just i use normal plugins to autoupdate the blogs. the script just transform the small texts into larger ones ;) is that the big secret ?
 
nope, there's more to it. I was also thinking longer and came to the conclusion i need some essential functionality, without this it wouldn' be very effective. (For this very specifc task i am planning to do this). Now i am sitting at that "functionality" which would be (to say it mildy, sensational). I know that there is NO program out there doing this.

Anway....yes...basically its a scraper, site-builder....but it does something very specific and with that added functionality it would be killer :)
 
Back
Top