[Method] Unique Well Written Content

Off3rz

Newbie
Joined
Oct 21, 2009
Messages
48
Reaction score
17
NOINDEX-RSS


This Method was discovered by accident a couple of days ago while trying to make a full RSS feed using yahoo pipes:

I found that some RSS feeds were not being pulled due to the "noindex" or sometimes the full content page was protected by robots.txt :D

Since then I've been testing RSS feeds via the same pipe to find the ones not indexed and to "borrow" the content from these pages.

I used sean815 yahoo pipes tutorial to take a RSS feed that only displays a summary and convert the feed to display the entire content of the article or news story. You'll have to search for this tutorial as I can't post links to the forum yet.

Hope that you'll find this useful
 
NOINDEX-RSS


This Method was discovered by accident a couple of days ago while trying to make a full RSS feed using yahoo pipes:

I found that some RSS feeds were not being pulled due to the "noindex" or sometimes the full content page was protected by robots.txt :D

Since then I've been testing RSS feeds via the same pipe to find the ones not indexed and to "borrow" the content from these pages.

I used sean815 yahoo pipes tutorial to take a RSS feed that only displays a summary and convert the feed to display the entire content of the article or news story. You'll have to search for this tutorial as I can't post links to the forum yet.

Hope that you'll find this useful

that's wicked man. i love it! you submit these to directories? or just use on own?
 
Submit them to directories? Do u mean the content?!
Of course not I use the content on my own properties!!!

BTW; Most of the news pages have NOINDEX feeds ;)
 
Great idea. Will search for the tutorial. If anyone else has the link please post it here.
 
Can you please explain a little more on how you are using the pipes? I have done the tut, and created my own rss feed from 5 or 6 different feeds. I am not quite clear on how you are using the pipes to find the no-index content? Can you perhaps setup an example pipe for us to see how you do this?
 
turoc; there is nothing special that I really do.
Just create the pipe and grab your feeds, when a feed returns an error or don't get fully pulled go and check the HTML source of the original article.

Again, try the news sites to have a feel of what I'm saying
 
what a good suggestion man. thanks for the share
 
Here is that link
Code:
http://www.blackhatworld.com/blackhat-seo/blogging/157390-yahoo-pipe-tutorial-convert-rss-summary-rss-full-feed.html
 
rss is not indexed but if the page is indexed we've got duplicate content at all. the only way is to find the pages that are not indexed yet and to force google to find your publication before the original one. with the news sites it will be very difficult to do this. Am I missing sth?
 
I believe there is someone out there who has created an automated tool out of this and this person should share it with me.
I'm in desperate need of quality content and don't have the time to create mine.

Can such a tool be created by Ubot?
 
you mean those posts are not indexed google ?

so that we can use to our blogs right ?
 
wow! i have to try it, gotta read sean post! hope there is a wordpress method for this cool share! thanks
 
Maybe those post aren't indexed via RSS, but Goolge will have them indexed via web
 
Maybe those post aren't indexed via RSS, but Goolge will have them indexed via web
The noindex is a meta tag that tells the web spiders to avoid indexing this page. Most propably this is done with news pages as the site would have thousands of those and don't wish to apear in the search engines for some piece of old news. There are many reasons ppl would use this tag for.
<meta name="robots" content="noindex">

This is the basic meta tag it can include more options or directions for the web crawlers.
I think u might be intersted in reading more about it
Code:
[B]hxxp://en.wikipedia.org/wiki/Noindex[/B]
 
I bet you're very gifted make such a great discovery , I really hope it works for me as well , gotta try it out soon !
 
I will also try this hope you help me in this, Thanks
 
Back
Top