1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

two robots.txt on a domain

Discussion in 'White Hat SEO' started by frankcisco, Apr 7, 2016.

  1. frankcisco

    frankcisco Junior Member

    Joined:
    Jan 24, 2014
    Messages:
    135
    Likes Received:
    9
    i have a domain with two scripts

    1 script is on root forlder with its own robots.txt

    2 script is on a folder /x

    im testing my robots.txt on google webmaster but what should i do?


    a : Add second script robots rules into root robots.txt

    like

    User-agent: *

    disallow: /x/images


    b : or i should use its own robots.txt from "X" direcory?

    User-agent: *

    disallow: /images
     
    Last edited: Apr 7, 2016
  2. SEO FOX

    SEO FOX Jr. VIP Jr. VIP

    Joined:
    Apr 27, 2015
    Messages:
    3,712
    Likes Received:
    753
    Gender:
    Male
    Location:
    Infront Of U!!
    Home Page:
    Go with the option 'b'
     
    • Thanks Thanks x 1
  3. MuayThai

    MuayThai Jr. VIP Jr. VIP

    Joined:
    Aug 25, 2015
    Messages:
    636
    Likes Received:
    190
    I prefer option A.
    But anyway I do not believe Google pays attention to robots.txt for past 2-3 years.
     
    • Thanks Thanks x 1