Robots.txt problem

just_seo_not_expert

Newbie

Mar 12, 2022

12

3

• Dec 11, 2022

• #1

What does it mean if robots.txt show this?

User-agent:Googlebot

Disallow:/?

User-agent:Scooter

Disallow:""

 

Black Belt Spodermen

Elite Member

Jan 18, 2016

2,803

1,681

• Dec 11, 2022

• #2

I found the exact parameters here: https://www.seoandwebservice.com/wi...ooglebot-disallow-user-agentscooter-disallow/

 

djsobuj

Elite Member

Jr. VIP

Jan 27, 2018

3,563

1,346

• Dec 11, 2022

• #3

Is my site robots OK?

# START YOAST BLOCK
# ---------------------------
User-agent: *
Disallow:

Sitemap: http://...........com/sitemap_index.xml
# ---------------------------
# END YOAST BLOCK