Close forum for guests but not for bots - vbulletin

foxy

Newbie
Joined
Dec 21, 2008
Messages
17
Reaction score
2
Is there way to close forum for guests but that bots from search engines can still see forum normally as member? I have heard their is a way to cloak in it but that's all I've heard......
 
Well the program is that bots are kind of guests. Why dont you want the guest to come? I guess you can redirect everything from Google to the first page?
 
Well the program is that bots are kind of guests. Why dont you want the guest to come? I guess you can redirect everything from Google to the first page?

I'm getting a bit of hassle from a Company because I show live football on the site. I've over 10000 members and I'd just like to close the entire forum off to members only but obviously I've gotten a busy forum due to my SEO on the forum and I rank highly in google for long tail links so if I could let the bots see everything it would help this continue.
 
You can do this fairly easily, but you ideally need an up to date IP list for the bots. You could use the free ones, but suspect you'd need the fantomas list. Also, being a forum and not just a run of the mill site, integrating it could be trouble some.

I actually think i have a script somewhere that allows you to do this, it's one of the one's within Search Engine Optimisation with PHP by Wrox, pm me if you want it and i'll make the effort to find it.

Google would also eventually ban you in all likelihood, as they see it as cloaking, simply because their spiders get a different view of the site than someone who follows a link. They allow NY Times to do it, but when it comes to us little guys it's just tough luck.
 
There is a script for this. It will make it impossible for guests to view content without registering and still allow search engines to crawl and index, hence sending visitors.

The big problem with this is it is very easy to do a google search for "KEYWORD site:yourdomain.com" when the results come up simply click on cached and you will be able to see content as a guest as you are receiving it from google and not your forum.

That is probably the best bet, just wish I could inf the name of the plugin that does this, I see it on lots of warez forums and forums that want to get more users to register.
 
You could always include a do not cache meta though i suppose? Well you'd have to otherwise they'd do as you say.
 
On phpbb isnt there an option to set permissions for bots like google etc.
 
Back
Top