1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Keeping certain groups of pages and post from being indexed

Discussion in 'Black Hat SEO' started by aoe316, Jun 20, 2015.

  1. aoe316

    aoe316 Regular Member

    Joined:
    Sep 25, 2013
    Messages:
    254
    Likes Received:
    100
    Hello, I have a question for all you wordpress users. Lets say I have 10 pages That I would like to take down for a while and might want to use them again. I know I can not send them to draft or the trash because they still will get indexed my google. How can I tell google not to index my drafts.
     
  2. bahus

    bahus Regular Member

    Joined:
    Jun 4, 2014
    Messages:
    342
    Likes Received:
    93
    Gender:
    Male
    Drafts are never indexed if they are not published. For all other pages, posts, use yoast seo for wordpress and set them, no follow, no index.
     
    Last edited: Jun 20, 2015
  3. aoe316

    aoe316 Regular Member

    Joined:
    Sep 25, 2013
    Messages:
    254
    Likes Received:
    100
    Yes, I know I could go one by one and do that to the post. I was wondering if I could set all drafts to be nofollow... And Bahus you are incorrect, google does index your draft pages that are not published.
     
  4. myopic1

    myopic1 Regular Member

    Joined:
    Mar 24, 2014
    Messages:
    408
    Likes Received:
    404
    Nope, he's right.
     
  5. aoe316

    aoe316 Regular Member

    Joined:
    Sep 25, 2013
    Messages:
    254
    Likes Received:
    100
    Are you sure? My drafts are indexed... Also try and google the question? I hope you both are right... But from my experience yesterday they do get indexed... If you do not go to nofollow in Yoast on the draft page itself, it will be indexed... I am pretty sure.
     
  6. aoe316

    aoe316 Regular Member

    Joined:
    Sep 25, 2013
    Messages:
    254
    Likes Received:
    100
    Any others care to chime in?
     
  7. kingmitch

    kingmitch Junior Member

    Joined:
    Apr 16, 2015
    Messages:
    142
    Likes Received:
    24
    Occupation:
    High Class Gigolo If you gotta ask you can't affor
    Location:
    All Over Your Face
    I would have to second bahus there's an option in wordpress seo by yoast for no-follow and no index
     
  8. aoe316

    aoe316 Regular Member

    Joined:
    Sep 25, 2013
    Messages:
    254
    Likes Received:
    100
    Yes I understand this. I actually said it in the op... What I am asking is if there is a way to make all draft's nofollow without going to each and every draft page and clicking no follow on yoast....
    Thank you though
     
  9. Y M C M B

    Y M C M B Power Member

    Joined:
    Sep 19, 2012
    Messages:
    622
    Likes Received:
    117
    as far as i know, drafts don't get indexed.
     
  10. Ch3Mik

    Ch3Mik Registered Member

    Joined:
    Apr 10, 2015
    Messages:
    99
    Likes Received:
    111
    Occupation:
    Survivor
    Location:
    Spain
    Only users with certain privileges (authenticated at least) could see those drafts. So unless your permissions are a real mess, you shouldn't be worried about that, because any bot (including Google) should get a 404 trying to scrape your drafts :)
     
  11. aoe316

    aoe316 Regular Member

    Joined:
    Sep 25, 2013
    Messages:
    254
    Likes Received:
    100
    Yes you are right... The problem I had I think is that they where indexed before I put them to draft.. I imported demmo content on a site. Some of the pages got indexed before I sent some to draft... It was only up for a small amount of time (Few Days) when it was indexed. I thought it would take longer then that. So thank you everyone for the help.
     
  12. bahus

    bahus Regular Member

    Joined:
    Jun 4, 2014
    Messages:
    342
    Likes Received:
    93
    Gender:
    Male
    I have seen google bot on a couple of occasions trying to access some of my drafts like: /?p=2123 however, they all came up on GWT as '404 page not found' and most certainly not indexed. Can't index 404 can you...
     
  13. bahus

    bahus Regular Member

    Joined:
    Jun 4, 2014
    Messages:
    342
    Likes Received:
    93
    Gender:
    Male
    It doesn't always have to do with privileges. In my case, I am the sole user/admin of my websites. However, for some reason yoast seo decided to include some of my drafts in sitemap thus causing google bot trying to access them. And like you said, it got 404.
     
  14. Ch3Mik

    Ch3Mik Registered Member

    Joined:
    Apr 10, 2015
    Messages:
    99
    Likes Received:
    111
    Occupation:
    Survivor
    Location:
    Spain
    It always has to do with privileges, that's it, by definition wordpress drafts will be only visible to certain users, depending on their role. That means that an anonymous visitor (i.e: Google Bot) shouldn't have access to the content. In fact, they try to access, because the content exists, but wordpress denies it, so a 404 page is served.

    When I talk about permissions mess I'm referring to some nasty assignments, because in Wordpress you can't assign capabilities to unknown users (i.e: Google Bot). That means that you have to write some code to make drafts visible to all visitors, with hooks, views and so on. You can't do that by accident :)

    Anyways, Google will crawl, not index, those urls. Hope I made myself a bit more clear :D



     
  15. bahus

    bahus Regular Member

    Joined:
    Jun 4, 2014
    Messages:
    342
    Likes Received:
    93
    Gender:
    Male
    I'm sorry to say but you're missing the point here, google doesn't crawl websites based on ... user permissions or whatever permissions you're talking about, in fact it couldn't care less about it. It crawls based on what you allow it to crawl regardless if the draft was created by someone with low or high permissions or how it is assign. And if the plugin that you're using to submit or update your site architecture for whatever reason includes a url to draft(s), it will attempt to crawl it regardless of who created it or permissions.

    At least we agree on one thing, if it comes across a url that points to a draft, it will get 404 and that page/post will not be indexed.