Don't link sitemap in robots.txt

A

azerbaijan

Newbie
Joined
Jun 4, 2023
Messages
10
Reaction score
2
Hello,

I don't want to link my sitemap in the robots.txt file, cause I dont want my competitors to see all the pages.

Will this have a negative impact on my site? I would submit we sitemap manually over GSC

Thanks
 
Advertise on BHW
As long as you submit it in gsc you should be fine. Which pages do you want to hide and why?
 
jamie3000 said:
As long as you submit it in gsc you should be fine. Which pages do you want to hide and why?
Click to expand...
This is true.

And if you include the subfolder as your permalink structure is even easier for anybody to scrape your index pages.

Like /services/ or /blog/
 
azerbaijan said:
I don't want to link my sitemap in the robots.txt file, cause I dont want my competitors to see all the pages.
Click to expand...
The sitemap of your site can anyways be accessed by your competitors by typing -

yoursitename.com/sitemap, or
yoursitename.com/sitemap_index.xml, or
yoursitename.com/sitemap.xml

Am I missing anything here?
 
sageshark said:
The sitemap of your site can anyways be accessed by your competitors by typing -

yoursitename.com/sitemap, or
yoursitename.com/sitemap_index.xml, or
yoursitename.com/sitemap.xml

Am I missing anything here?
Click to expand...

I don't think you have to name it sitemap.xml, could be /chicken-nuggets.xml as long as you submit it in gsc.
 
jamie3000 said:
I don't think you have to name it sitemap.xml, could be /chicken-nuggets.xml as long as you submit it in gsc.
Click to expand...
No mate, I am not talking in context of submitting to GSC. I was talking regarding OP's concern to hide the sitemap from his competitors eyes.

Honestly, I am hearing it for the first time to rename the sitemap file. But if that can be done then obviously his competitors can not find that.

By the way, how do you rename the sitemap.xml file? SEO plugins generate the sitemap, but do they provide the renaming facility? I never heard that.
 
If you prefer not to include your sitemap in the robots.txt file to keep it from competitors, that's perfectly fine. You can manually submit your sitemap through Google Search Console, and it won't impact your site negatively. Your competitors won't have access to it that way.

Cheers!
 
sageshark said:
No mate, I am not talking in context of submitting to GSC. I was talking regarding OP's concern to hide the sitemap from his competitors eyes.

Honestly, I am hearing it for the first time to rename the sitemap file. But if that can be done then obviously his competitors can not find that.

By the way, how do you rename the sitemap.xml file? SEO plugins generate the sitemap, but do they provide the renaming facility? I never heard that.
Click to expand...

Ah I've never generated it through a plugin. I've always manually built it with a scanner or had the PHP website I coded generate it. You may be right though, maybe SEO plugins don't generally allow you to rename it.
 
azerbaijan said:
Hello,

I don't want to link my sitemap in the robots.txt file, cause I dont want my competitors to see all the pages.

Will this have a negative impact on my site? I would submit we sitemap manually over GSC

Thanks
Click to expand...
According to my knowledge, excluding your sitemap from robots.txt won't affect your site's SEO, instead I would suggest you to focus on quality of content and also other methods to gain a competitive advantage
 
It is safe to skip linking your sitemap in robots.txt; manual submission via Google Search Console is fine and won't hurt your site's SEO.
 
I dont know HOW much of a difference it makes but it wont stop you from ranking and earning as I had a site that for years didn't have a robots.txt sitemap, and it was still ok, until finally I noticed it. I'm not sure if I still have the site, but I can't recall rankings suddenly going through the roof or the floor or anything, I'm sure I remember it as just staying the same. Been so long, and I didn't write down as much nonsense that I tried then as now! lol
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top