[REQ HELP] How to disallow Archive.org

L

l0l0

Registered Member

Dec 17, 2008

89

39

• Jan 16, 2009

• #1

Hi guys,

I searched Google for how to block Archive.org from my websites.
I have read somewhere that Archive.org is close related to Alexa, is this true?
So, what happen when i block Archive.org?
Will this affect my Alexa ranking?

Anyway, how can i disallow Archive.org (by .htaccess)?

Thanks in advance for your help

 

xhpdx

Regular Member

Sep 21, 2008

326

2,172

• Jan 16, 2009

• #2

you can do it with robots.txt

Code:

User-agent: ia_archiver
Disallow: /Folder/

with htaccess should look like this:

Code:

RewriteEngine On 
RewriteCond %{HTTP_USER_AGENT} ^ia_archiver
RewriteRule ^.* - [F,L]

 

L

l0l0

Registered Member

Dec 17, 2008

89

39

• Jan 16, 2009
• Thread Starter Thread Starter

• #3

Thanks for your fast reply XHPDX
Yes, i made a mistake, it have to be with Robot.txt ofcourse.
Im gonna try this, thanks again

 

S

shahfil

Newbie

Nov 16, 2008

5

4

• Jan 16, 2009

• #4

btw, Robot.txt != robots.txt

 

xhpdx

Regular Member

Sep 21, 2008

326

2,172

• Jan 17, 2009

• #5

shahfil said:

btw, Robot.txt != robots.txt

Click to expand...

yes, make sure the file is robots.txt, not just robot.txt as this won't work