Google rebots.txt


Regular Member
Mar 20, 2019
Reaction score
Hey guys upon updates on the site that was indexed on Bing and not indexed on Google. after checking coverage on search console i. i did check coverage and i got i message saying "linked crawled but not indexed" so i did checking robots.txt file blocking but this is what it shows

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

i don't know if this is good because from my understanding for google to crawl all pages for index . All "Disallow" above has to be "Allowed".

also i did check settings from my WordPress to see if i had mistakenly click on "Discourage search engines from indexing this site " but everything is fine.

I still don't know what else to do. How can i change the Robots.txt above?? for google to crawl all pages and index site.

N/B i am building quality links and i have linked pages internally. Thanks any recommendations will be great