Extracting / parsing articles from scraped websites?

I want to extract articles from websites I am scraping.. the only easy was I see to do this is by finding rss feeds that are full length, which is hard to find and then I'm missing out on all those that don't..

I have programmers working for me but I'm not sure how to approach this issue since the articles are from different websites, its not like you can make just one extractor app based on their layout since it changes from site to site.. I have thought of something that would do something like take each area of unbroken text (meaning text that appears within 1 DIV or Table) and then determine the length of this and then the text area with the longest length would be determined to be the article.. anyways, just wondering if anyone has made anything like this before?

I run 2 scripts for my autoblogs that can extract the full articles.
I've tried a lot a solutions and my advice is not to rely on layout but to base the script on text density.
Posted via Mobile Device

Ok cool, hadn't thought of it that way before, I did a quick google search and found this:

http://ai-depot.com/articles/the-easy-way-to-extract-useful-text-from-arbitrary-html/

So I get what you mean, this should definitely be useful