HELP: Robots.txt showing 90% websitel Links as BLOCKED on Google Webmaster!

[ran60616]

Hey guys,

Any help would be much appreciated.

Here is how my robots.txt file looks like when anyone looks at it online.

User-agent: *
Disallow: /wp-admin/

Also when I do a Google Search to find how many links are indexed, more than 1000+ shows up in the results. "Site:www.mysite.com" search string.

However, on my Google Webmaster Tools it shows the following results under "Google Index">"Index Status".

Total Indexed: 1062
Blocked by robots: 913

Any thing I should look at to solve this problem?

Thank you!

 

[Gogol]

Try fetching the robots.txt again from Crawl as Google bot ( and press submit to index).

 

[ran60616]

Try fetching the robots.txt again from Crawl as Google bot ( and press submit to index).

Thank you for the suggestion. Will give it a try!

 

[angry cowboy]

what does robot.txt file do?

 

[mysticDrac]

what does robot.txt file do?

it is first place where google bots land while crawl your site, they will see what can be index or not , after that sitemap

 

[Lermontov]

Login to the webmaster tool to block the crawl, that will make Google remove them from search result faster.

 

[ran60616]

Try fetching the robots.txt again from Crawl as Google bot ( and press submit to index).

No luck so far!

 

[Gogol]

Hmm strange. What you have posted here looks okay to me.I can have a look if you PM me your site url.

No luck so far!