1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Sitemap contains urls which are blocked by robots.txt

Discussion in 'Blogging' started by coolkasun, Feb 15, 2016.

  1. coolkasun

    coolkasun Newbie

    Joined:
    Feb 8, 2016
    Messages:
    20
    Likes Received:
    2
    Sitemap contains urls which are blocked by robots.txt

    How to fix this issue ??
     
  2. Dilettante

    Dilettante Power Member

    Joined:
    Jan 9, 2014
    Messages:
    746
    Likes Received:
    292
    Modify your robots.txt ?
     
  3. redarrow

    redarrow Elite Member

    Joined:
    Apr 1, 2013
    Messages:
    6,001
    Likes Received:
    1,453
  4. obalouafi

    obalouafi Newbie

    Joined:
    Nov 14, 2015
    Messages:
    23
    Likes Received:
    2
    Home Page:
    change your robots.txt file to be compatible with your sitemap
     
  5. clevelandslim

    clevelandslim Jr. VIP Jr. VIP

    Joined:
    Nov 15, 2008
    Messages:
    1,973
    Likes Received:
    191
    Yes. You need to change your robot.txt file
     
  6. Programmingonline

    Programmingonline BANNED BANNED

    Joined:
    Feb 16, 2016
    Messages:
    21
    Likes Received:
    2
    check your txt file add some line of code and unblock it
     
  7. Mikaelo

    Mikaelo Regular Member

    Joined:
    Nov 10, 2013
    Messages:
    461
    Likes Received:
    109
    Location:
    Australia
    Very easy fix, just got to the root of your website & manually remove the lines. In web master tools there is a cool function where you can test if URL's are blocked by robots. Enjoy!