Any interest in this type of content bot?

General Lee

Regular Member
Joined
Jan 26, 2012
Messages
230
Reaction score
1,016
I've been working on a bot that basically scrapes content from various sources that isn't indexed, be it expired, deindexed or not indexed for various other reasons. The point being is that the content is 100% orginal in the eyes of a search engine.

For example if I type in "cigars" it'll generate 1000's of 1000's of words of content on this targeted keyword.

I've actually built several sites here recently using this content and all of my web 2.0s have orginal content as well. The bot still needs work filtering out which content is worth while and which content is crap.
 
Everyone will be interested but it will work only if you restrict access to a few
 
Some times google doesn't index crap content. If that can be filtered out during the scrape then it is 100% needed one.
 
it would be awesome as long as it scrapes whole posts / articles. If it scrapes random words and sentences, then it would be a bit less awesome ;) I guess, you could always set a filter (minimum number of words) when scraping
 
btw the webarchive site and the co.cc domains might be good sources, but then again, the co.cc domains are pretty much built on already scraped, used, reused, and abused content which is the reason G dropped them
 
That would be great for one of my sites. I am trying to collect historical/background information.
 
I think the problem will be (if its the methods im thinking of) is that it will become saturated very quick as people will be using it for website content and tier1 so if you have heavy users in the same niche it could be a problem. The other thing is once you release a public bot the methods will be more in the public eye hense more people will do it. If your going to do it I would keep it private and restrict it to several people or keep it to yourself knowing you will always have unique content
 
Last edited:
IMO a problem would be the fact that lots of the content isn't being indexed because it is of a crappy spun quality.
 
Back
Top