Ok, so I'm using a simple .php code to cloak my affiliate links.
I have ...
-
Blocking Google from crawling certain folder.
Ok, so I'm using a simple .php code to cloak my affiliate links.
I have a subfolder setup on my server called "go" for example that has all the php files in it and nothing else.
I was reading some posts on here and didn't see a clear answer. Should I make a simple robot.txt to disallow search engines from crawling it?
Does it hurt my SERPS letting google crawl it and having them find out that I'm an affiliate? That's my main question and only reason I would block G. from crawling it.
Thanks for any help!
-
-
-
Re: Blocking Google from crawling certain folder.
What I would do is use htaccess to either block Google or have Google see something different by rewriting the URL.
-
-
Re: Blocking Google from crawling certain folder.
Google respects robots.txt. Just write in that bots aren't allowed to access those pages.
-
-
Re: Blocking Google from crawling certain folder.
Look over this page there a couple of ways. I use meta tag.
Code:
http://antezeta.com/news/avoid-search-engine-indexing
-
-
Re: Blocking Google from crawling certain folder.

Originally Posted by
machines-in-motion
Google respects robots.txt. Just write in that bots aren't allowed to access those pages.
This. But be aware some users will look at your robots.txt to try to find hidden shit.
-
Similar Threads
-
By Diamond Damien in forum Adsense
Replies: 13
Last Post: 02-15-2011, 12:43 PM
-
By abhi1 in forum BlackHat Lounge
Replies: 6
Last Post: 07-08-2009, 10:31 AM
-
By Diamond Damien in forum BlackHat Lounge
Replies: 1
Last Post: 02-06-2007, 08:26 AM
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules
Bookmarks