1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Why is Majestic not bypassing .htaccess?

Discussion in 'Black Hat SEO' started by Kanye West, Sep 26, 2016.

  1. Kanye West

    Kanye West Newbie

    Joined:
    Aug 15, 2014
    Messages:
    40
    Likes Received:
    8
    Gender:
    Male
    Why are third party link crawlers not bypassing .htaccess by using fake user agents?
     
  2. agent-x

    agent-x Junior Member

    Joined:
    Apr 4, 2012
    Messages:
    173
    Likes Received:
    34
    Gender:
    Male
    How do you know they're not?
     
  3. Lone Wolf

    Lone Wolf Junior Member

    Joined:
    Aug 27, 2015
    Messages:
    152
    Likes Received:
    34
    Location:
    Nah
    Because it's disrespectful and wouldn't do their reputation any good.
     
  4. DigitalCon

    DigitalCon Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 27, 2014
    Messages:
    516
    Likes Received:
    87
    Gender:
    Male
    Occupation:
    Internet Research
    Location:
    Home
    Home Page:
    Do you want them to?
     
  5. xjapan

    xjapan Power Member

    Joined:
    Sep 16, 2014
    Messages:
    648
    Likes Received:
    77
    Location:
    unknown
    bypass or not bypass?
     
  6. THUNDERELVI

    THUNDERELVI Elite Member

    Joined:
    Sep 12, 2009
    Messages:
    2,399
    Likes Received:
    2,074
    Gender:
    Male
    Location:
    W3
    Because they don't have access to that file, only you do and the hosting company that manages the servers. The .htaccess file is hidden in your server's directody and cannot be accessed externally unless they have your FTP/login details.