1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

robot denied error

Discussion in 'White Hat SEO' started by scalerman, Sep 22, 2013.

  1. scalerman

    scalerman Registered Member

    Joined:
    Aug 28, 2013
    Messages:
    67
    Likes Received:
    19
    I was checking my adsense account and I see a site that has a robot denied error. It is for/wp-admin page. Tried the search function first but couldn't locate any info regarding this. Any way to fix this?
     
  2. the_demon

    the_demon Jr. Executive VIP

    Joined:
    Nov 23, 2008
    Messages:
    3,187
    Likes Received:
    1,574
    Occupation:
    Search Engine Marketing
    Location:
    The Internet
    It should be fine. Google shouldn't be crawling that directory anyways.

    Sometimes they throw a hissyfit if they can't crawl everything with no restrictions. Unless it's preventing your ads from serving don't worry about it.

    However, if your robots.txt file is blocking your whole site you've got a big problem.

    You can check this file by going to www.example.com/robots.txt

    MORE INFO HERE --> http://www.robotstxt.org/
     
    Last edited: Sep 22, 2013
  3. scalerman

    scalerman Registered Member

    Joined:
    Aug 28, 2013
    Messages:
    67
    Likes Received:
    19
    Thank you for the reply. I will check out the links. My ads are showing fine but I still want to make sure.