1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Hide Pages from user, but show google (not cloaking)

Discussion in 'Blogging' started by Bloghat, Oct 7, 2011.

  1. Bloghat

    Bloghat Regular Member

    Joined:
    Feb 18, 2011
    Messages:
    249
    Likes Received:
    120
    I thought it would be nice, to have a forum which is crawled by google (many good working keywords in that niche) but is private if being browsed by a human.
    So google knows all the private pages and has them in the serp, but when people click on it, they get a 'please register to see the page'.

    Is this possible?
     
  2. dspiel

    dspiel Registered Member

    Joined:
    Sep 20, 2011
    Messages:
    71
    Likes Received:
    11
    Maybe having a sitemap with the urls you want google to index but have no way for the user to navigate to those pages unless they read the sitemap. I'm not 100% that would be sufficient though.
     
  3. Bloghat

    Bloghat Regular Member

    Joined:
    Feb 18, 2011
    Messages:
    249
    Likes Received:
    120
    But if G indexes the patge (from sitemap) people will reach that site via the serp. So they would get in the same moment, they find the site on G.
     
  4. orbit

    orbit Regular Member

    Joined:
    Nov 1, 2007
    Messages:
    372
    Likes Received:
    68
    I was just thinking about how to do this as well. Would like to know if there is a way.
     
  5. The Doctor

    The Doctor Jr. VIP Jr. VIP

    Joined:
    Dec 18, 2010
    Messages:
    612
    Likes Received:
    188
    Occupation:
    Computer Scientist, Engineer, Programmer.
    Location:
    ☆☆☆☆☆☆
    what forum software are you using? I've seen lots of forums like what you're describing. Especially in the niche of providing expert help to people. There have been times when I visited a forum and the only way to see the content without paying or registering was to switch my user agent to Googlebot. Thats what you need. A plugin that can restrict certain areas to registered members or the googlebot useragent. Its also worth mentioning that it is possible to tell if someone is REALLY googlebot or not by not only looking at the useragent but also looking at the IP/dns of the visitor since googlebot only comes from certain IPs.
     
  6. ronegraT

    ronegraT Power Member

    Joined:
    Dec 29, 2010
    Messages:
    620
    Likes Received:
    101
    Occupation:
    sleeping
    Location:
    Sweden
    I have acctually never used a forum myself, but couldn´t you just add googles ip adress as safe someway and they can watch the entire board as if they where logged in? I know a couple of forums which allows you to read a few posts before you need to register, but thats probably not what you wanted
     
  7. Bloghat

    Bloghat Regular Member

    Joined:
    Feb 18, 2011
    Messages:
    249
    Likes Received:
    120
    The forum is not there yet, I'm still at planning ahead. I guess I will be taking mybb - I fear simplePress (though easier to integrate into my wp-project) might have limits that get into my way later.
    @Fumanchau, that's exactly what I am looking for, seen it myself and wondered how they're doing it.
     
  8. Bloghat

    Bloghat Regular Member

    Joined:
    Feb 18, 2011
    Messages:
    249
    Likes Received:
    120
    @ronegrat: Since I will offer very useful (readable) stuff, I want to lock them out without registering. They don't need to pay to see it (though I've been told I could take money for it), but at least I want their email adress. It's not that important if they can post or not, it's about being able to read it...
     
  9. christoss1959

    christoss1959 Senior Member

    Joined:
    Nov 25, 2010
    Messages:
    894
    Likes Received:
    1,150
    Home Page:
    I've seen forums like that. But note if you do this then the user can ask to see Google cached version and still see the page without registering (that is what I did!).
    One of the forums that does this is (I am not sure how they do it but looking at their html code will help you):
    Code:
    www.hackforums.net
     
  10. Bloghat

    Bloghat Regular Member

    Joined:
    Feb 18, 2011
    Messages:
    249
    Likes Received:
    120
    @christoss that would be enough, the info that I have would make them come back often and they would be soon annoyed to go back to search every minute instead of surfing the page naturally. Any insights, hwat I need to copy that behaviour?
     
  11. CyberSEO

    CyberSEO Senior Member

    Joined:
    Jul 14, 2011
    Messages:
    939
    Likes Received:
    255
    Occupation:
    programmer
    Home Page:
    If you want, I can write such a plugin for you. So only Google and other search engines you specify will be able to see the content, others will be redirected to the page you want (sign up or whatever).
     
  12. Bloghat

    Bloghat Regular Member

    Joined:
    Feb 18, 2011
    Messages:
    249
    Likes Received:
    120
    @cyberseo, if people click on the serp link, they would get in (without navigating your page) what's the use of that? Ok, i guess for some pages that would work, but i have bunch of connected lists, so if you get into the page (via serp) you could surf the rst. So i need the permission management of a forum
     
    Last edited: Oct 8, 2011
  13. CyberSEO

    CyberSEO Senior Member

    Joined:
    Jul 14, 2011
    Messages:
    939
    Likes Received:
    255
    Occupation:
    programmer
    Home Page:
    Nope, they wouldn't.
     
  14. Bloghat

    Bloghat Regular Member

    Joined:
    Feb 18, 2011
    Messages:
    249
    Likes Received:
    120
    Ok, that would work then. Have yet to decide on a software. Found out simple press can only secure registering with math captchas, easy to bypass for a bot.
    Would your solution work with any forum?
     
    Last edited: Oct 8, 2011
  15. Bloghat

    Bloghat Regular Member

    Joined:
    Feb 18, 2011
    Messages:
    249
    Likes Received:
    120
    I asked on that mentioned forum for their solution and they said mybb would allow such behaviour right out of the box. You would have to set different permissions for guests and spiders.