does google can access pages with password?

genotip

Regular Member
Joined
Aug 24, 2010
Messages
257
Reaction score
27
hi,
does google can access pages with password?


thanks
 
i'm guessing no, think about it , what would be the use to index a protected page ? When entrance would be denied right off the bat ?

Altough i think it is possible to create some special crawler accounts for them to get indexed (on some forums at least)
 
Google can't access pages which are password protected. Anybody, does not matter who, needs to know the password to access such a page
 
are you sure?what about the forums?i always use google for accesing password protected threads...
 
There is something like Google Bot its like account but its bot, maybe someone with more details could say something about that.
 
are you sure?what about the forums?i always use google for accesing password protected threads...

What those forums do is cloaking, they allow known
google ip (like 66.249.71.75) to craw its pages while
blocking unknown ip (users). That's why you can
have access to cache version of the page but not
the real page unless you authenticate.

These forums allow google to index their protected
pages hoping that users might find their pages on
google.
 
I think it cant.... It access the forums, because you can read those forums without logging in... To access the password protected pages, the session has to enabled.

BTW you can use robot.txt to tell not to crawl the some pages of your website...
 
On forums and such, yes. I'm not sure about sites where you need a password and username just to begin downloading the site. Probably not.
 
Exactly correct, forum admins allow googles ip to crawl their forums just like a regular user.

Whats great is when you want to view the protected thread but the forum wants you to signup to view, just view goolge cache of the page, grab what you need and be done with it.


Man.. Where are you getting avatars like this...??? LMAO
 
Back
Top