how do we hide our pages from search engines? cache?

[blackhat50]

hello how do i make it so the search engines doesn't see our pages and no cahche of the page is saved for our Blackhat Pages?


thanks in advance

 

[lase]

Use the robots.txt file and make it noindex all the pages you don't want indexed.


http://www.robotstxt.org/

 

[JonesersRX7]

But... can't people just read your robots.txt file?

 

[davejug1]

Indeed they can, robots sucks, place the following code in the header of every page you don't want indexing:

<meta name="robots" content="noindex, nofollow, noarchive">

 

[blackhat50]

Thank you davejug.

 

[biznets]

hello how do i make it so the search engines doesn't see our pages and no cahche of the page is saved for our Blackhat Pages?


thanks in advance

Why would you want to?cguru:

 

[dadrian]

view my site, and there is a perfectly readable and understandable example
The spiders cannot see anything in the noindex folders.

Here it is:

natural-products-review.com/robots.txt

the * specifies that the instructions apply to all spiders, including googlebot

 

[davejug1]

view my site, and there is a perfectly readable and understandable example
The spiders cannot see anything in the noindex folders.

Here it is:

natural-products-review.com/robots.txt

the * specifies that the instructions apply to all spiders, including googlebot

Spiders can't but humans can, the robots file is a widely known flaw. Even malicious spiders exploit it