Discussion in 'Black Hat SEO' started by Kanye West, Sep 26, 2016.
Why are third party link crawlers not bypassing .htaccess by using fake user agents?
How do you know they're not?
Because it's disrespectful and wouldn't do their reputation any good.
Do you want them to?
bypass or not bypass?
Because they don't have access to that file, only you do and the hosting company that manages the servers. The .htaccess file is hidden in your server's directody and cannot be accessed externally unless they have your FTP/login details.
Separate names with a comma.