Good and Bad Web 2.0 Sites List

Mine is indexed.Made 2 days ago. Seems like 2nd robots disallow oatch should be / for site to be blocked.

Code:
User-agent: psbot
 Disallow: /
 User-agent: *
 Disallow:
 Crawl-delay: 10
 Sitemap: http://something.xml
Thats weird cuz mine were blocked. Anyway you can add to the working list bleep.com, busythump (highly moderated non spammable), fc2.com, obolog.com
 
I have a livejournal blog and it's indexed. I guess it depends on how often the blog is updated. I updated mine always with tweets and FB posts apart from normal blog posts.

If you would create a new one, it probably won't be indexed. It only applies on blogs made after certain date. I have old blogs that are indexed bu new ones aren't.
 
Thats weird cuz mine were blocked. Anyway you can add to the working list bleep.com, busythump (highly moderated non spammable), fc2.com, obolog.com

Add on the "bad" list?

Post your robots file here.
 
Last edited:
Ok.

Note to a moderator. Please allow, if possible for the first post in this thread to be permanently editable.
 
Wow, vmoptions.com has such an awesome lists. It will take me forever to do this manually though, especially adding great original content. Time to work now.
 
Actually http://wix.com is a bad site, cause the article shown is embedded in java script, so even if the site gets indexed there would be no backlink to your site.
 
Last edited:
I created a site with xanga.com 5 months ago and it hasn't been indexed yet.
 
Thanks for list... I'm hunting down all the list that I would need for my upcoming campaigns. Knowing this really comes in handy.
 
Added 5 rep points for you. Keep this up. It's very useful. Especially finding which ones delete often and which are not indexable. Keep it up!!
 
Added 5 rep points for you. Keep this up. It's very useful. Especially finding which ones delete often and which are not indexable. Keep it up!!

I will as it is useful for everyone including myself.
 
I created a site with xanga.com 5 months ago and it hasn't been indexed yet.

I do no see any problem, some content is there and the robots.txt file is ok. Is any of your blogs on Xanga indexed?

Code:
User-agent: * Disallow: /sitemessage.aspx Disallow: /error.aspx Disallow: /sorry.aspx Disallow: /CaptchaImage.axd Disallow: /randletters.aspx Disallow: /xangalock.aspx Disallow: /RecommendHandler.ashx Disallow: /externalloginrejectedterms.aspx Disallow: /externalloginacceptedterms.aspx Disallow: /twittercallback.aspx Disallow: /twitteroauth.aspx Disallow: /facebookauthcode.aspx Disallow: /facebookdomainchange.aspx Disallow: /facebookoauth.aspx Disallow: /externallogout.aspx  Sitemap: http://.*.xanga.com/sitemap.txt
 
Last edited:
Back
Top