orkney
Newbie
- Sep 26, 2016
- 16
- 13
You can prevent the Wayback Machine from crawling your site by adding the following to your robots.txt file in the root directory:
User-agent: ia_archiver
Disallow: /
Not sure if this will prevent viewing old archives of your site from appearing in the Wayback Machine but I'm pretty sure it does
User-agent: ia_archiver
Disallow: /
Not sure if this will prevent viewing old archives of your site from appearing in the Wayback Machine but I'm pretty sure it does