Why is Majestic not bypassing .htaccess?

Kanye West

Junior Member

Aug 15, 2014

147

39

• Sep 26, 2016

• #1

Why are third party link crawlers not bypassing .htaccess by using fake user agents?

 

agent-x

Regular Member

Apr 4, 2012

337

139

• Sep 26, 2016

• #2

How do you know they're not?

 

Lone Wolf

Junior Member

Aug 27, 2015

151

35

• Sep 28, 2016

• #3

Because it's disrespectful and wouldn't do their reputation any good.

 

DigitalCon

Power Member

Jul 27, 2014

538

99

• Sep 28, 2016

• #4

Do you want them to?

 

xjapan

Power Member

Sep 16, 2014

789

115

• Sep 28, 2016

• #5

bypass or not bypass?

 

THUNDERELVI

Elite Member

Sep 12, 2009

2,551

2,305

• Sep 28, 2016

• #6

Because they don't have access to that file, only you do and the hosting company that manages the servers. The .htaccess file is hidden in your server's directody and cannot be accessed externally unless they have your FTP/login details.