Blocking Google from crawling certain folder.

Ok, so I'm using a simple .php code to cloak my affiliate links.

I have a subfolder setup on my server called "go" for example that has all the php files in it and nothing else.

I was reading some posts on here and didn't see a clear answer. Should I make a simple robot.txt to disallow search engines from crawling it?

Does it hurt my SERPS letting google crawl it and having them find out that I'm an affiliate? That's my main question and only reason I would block G. from crawling it.

Thanks for any help!

What I would do is use htaccess to either block Google or have Google see something different by rewriting the URL.

Google respects robots.txt. Just write in that bots aren't allowed to access those pages.

Look over this page there a couple of ways. I use meta tag.

machines-in-motion said:

Google respects robots.txt. Just write in that bots aren't allowed to access those pages.

Click to expand...

This. But be aware some users will look at your robots.txt to try to find hidden shit.