For my robots.txt, if I want it to just not index a certain directory, I just place it like so, right?:
User-agent: *
Disallow: /directory/
Well if that's the case, I've done it, and when I check my indexed pages it has index all those pages in that directory. Am I doing it wrong, or anything?
User-agent: *
Disallow: /directory/
Well if that's the case, I've done it, and when I check my indexed pages it has index all those pages in that directory. Am I doing it wrong, or anything?