1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Denied by robots.txt webmaster tools

Discussion in 'Black Hat SEO' started by accessaw, Jul 24, 2012.

  1. accessaw

    accessaw Newbie

    Joined:
    Feb 23, 2009
    Messages:
    47
    Likes Received:
    59
    Location:
    Ireland
    my other site is working fine here is what's showing in my robots.txt

    User-agent: *Disallow: /wp-admin/Disallow: /wp-includes/Any help appreciated
     
  2. emph4tic.gh0st

    emph4tic.gh0st Newbie

    Joined:
    Jul 24, 2012
    Messages:
    2
    Likes Received:
    1


    I don't fully understand what it is your asking for help with. robots.txt is a ruleset in place by the webmaster that tells search engines where they can peek and poke.

    in this case its disallowing /wp-admin and /wp-includes so they dont get indexed in the SERPs.


    Elaborate more as to what your issue is and what it is you are trying to accomplish if you wouldnt mind and maybe i can answer whatever question it is you are posing to us.

    Thanks.
     
  3. accessaw

    accessaw Newbie

    Joined:
    Feb 23, 2009
    Messages:
    47
    Likes Received:
    59
    Location:
    Ireland
    Ok in wmt it is showing that I have 52 urls blocked and that google is blocked from my site.
     
  4. emph4tic.gh0st

    emph4tic.gh0st Newbie

    Joined:
    Jul 24, 2012
    Messages:
    2
    Likes Received:
    1
    from what your describing it sounds like G crawled those directories and keeps them out of ethe serps. add up the amount of subfolders/files in the /wp-admin + /wp-includes.

    if thats not it im not entirely sure then. dork your site with a google search with site: in front of your url

    and see whats indexed.
     
    • Thanks Thanks x 1