1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Robots.txt file for two CMS in same domain

Discussion in 'White Hat SEO' started by sinbad007, Aug 11, 2016.

  1. sinbad007

    sinbad007 Newbie

    Joined:
    Jun 17, 2016
    Messages:
    16
    Likes Received:
    1
    Gender:
    Male
    Hi,

    Yesterday, one of my friend asked this question.

    I have a website example.com, which is created using Drupal CMS with a sub domain blog "http://www.example.com/blog" which has Wordpress CMS. I would like to block few posts in "http://www.example.com/blog/examplepost/ from search engine index by using robots.txt file.

    I would like to know, should I have to use separate robots file for each CMS, ie, http://www.example.com/robots.txt file for Drupal and http://www.example.com/blog/robots.txt for Wordpress or will the main domain robots file(Drupal) will work for "http://www.example.com/robots.txt"(Wordpress).

    The same question applies for XML Sitemap.