Webs.com blocked robots.txt file

myfault

Senior Member

Sep 21, 2012

970

242

• Jun 29, 2014

• #1

I had created web2.0 sites but few sites disallow/ in robots.txt but google indexed those links but it is showing = A description for this result is not available because of this site's robot.txt. This mean google not giving me the credit of that web 2.0 site in ranking ?

 

myfault

Senior Member

Sep 21, 2012

970

242

• Jun 29, 2014
• Thread Starter Thread Starter

• #2

ohh... 90 views and no reply ?

 

djw1606

Power Member

Jan 24, 2014

654

390

• Jun 29, 2014

• #3

Yes, you are not getting credit for the link because google bot can't crawl it. There are certain web 2.0 sites that do this. LiveJournal is another. It only seems to affect new accounts. People who have had a LiveJournal account for some time don't have this problem. I think I read somewhere that if you post regularly, then LiveJournal will remove this block.

 

L

LiquidKnight

Newbie

Jun 30, 2014

17

1

• Jun 30, 2014

• #4

It's a block that more and more web 2.0 websites are setting up to prevent people from just creating accounts to generate backlinks.

 

wisdomkid

Elite Member

Jun 20, 2011

3,582

1,188

• Jun 30, 2014

• #5

But the more you publish articles there, the better for your blog.

 

umerjutt00

Elite Member

Oct 28, 2011

4,373

2,493

• Jun 30, 2014

• #6

I also noticed it sometime back. You have to buy a paid plan in order to edit the robots.txt.