How would you use a competitor's Sitemap.XML?
- Thread starter Southron
- Start date
- Jun 9, 2020
- 6,584
- 3,258
I would use it for finding cluster pages
- Jun 15, 2019
- 8,933
- 4,412
With sitemap you can find out what kind of content they are publishing in their blog if they have any. Other than that, the url structure they are following.
hideath
Elite Member
- Jun 16, 2019
- 6,620
- 7,350
Just to find all their pages for whatever reason you need it,
Mainly used for scraping kind of stuff, but you can use to easily check number of their pages/content, all categories, etc...
Another use would be to run all of the URLs into a keyword checking tool and collect what each page is ranking for
Mainly used for scraping kind of stuff, but you can use to easily check number of their pages/content, all categories, etc...
Another use would be to run all of the URLs into a keyword checking tool and collect what each page is ranking for
jennykumar
Senior Member
- Nov 14, 2012
- 926
- 480
nothing illegal, its just as good as a publicly available index.html page. It will only be unethical or illegal if it was behind a password-protected page and the competitors peeps into it.
While I keep my sitemap files with other names that only search engines can access and ahrefs/semrush etc are banned via cloudflare rules so the automated bots don't even reach my robots.txt file (which is just one-line file now)
RogueDreamer
Regular Member
- Nov 29, 2023
- 367
- 139
in my opinion, you just use the sitemap to know about your competitors content they publish.
Thanks everyone for the answers, very helpful.
There was an idea to do reverse engineering, I thought maybe there were some detailed tactics on how to do this most efficiently.
Maybe there are some scripts that allow to find them in bulk, quickly process, remove duplicates, and build a ready-made structure from unique headings or content.
There was an idea to do reverse engineering, I thought maybe there were some detailed tactics on how to do this most efficiently.
Maybe there are some scripts that allow to find them in bulk, quickly process, remove duplicates, and build a ready-made structure from unique headings or content.
CipherShadow10
Regular Member
- Dec 22, 2023
- 306
- 117
sitemaps are used to see our competitors webpage contents.
SERP Rocker
Junior Member
- Nov 20, 2023
- 181
- 47
The first step is to view a competitor's sitemap. For example, you may find a website's sitemap by entering the website URL followed by /sitemap.xml into the browser address bar. For example, if your competitor's website is www.example.com, you'd type www.example.com/sitemap.xml.
- Jan 9, 2024
- 459
- 30
walcome