Y T Nuke  
Results 1 to 5 of 5
Ok, so I'm using a simple .php code to cloak my affiliate links. I have ...
  1. #1
    Markthedude's Avatar
    Markthedude is offline Regular Member
    Join Date
    Feb 2010
    Location
    United States
    Posts
    416
    Reputation
    72
    Thanks
    101
    Thanked 173 Times in 107 Posts

    Question Blocking Google from crawling certain folder.

    Ok, so I'm using a simple .php code to cloak my affiliate links.

    I have a subfolder setup on my server called "go" for example that has all the php files in it and nothing else.

    I was reading some posts on here and didn't see a clear answer. Should I make a simple robot.txt to disallow search engines from crawling it?

    Does it hurt my SERPS letting google crawl it and having them find out that I'm an affiliate? That's my main question and only reason I would block G. from crawling it.

    Thanks for any help!

  2. #2
    shadowrizer is offline Newbies
    Join Date
    Feb 2011
    Posts
    10
    Reputation
    10
    Thanks
    4
    Thanked 0 Times in 0 Posts

    Default Re: Blocking Google from crawling certain folder.

    What I would do is use htaccess to either block Google or have Google see something different by rewriting the URL.

  3. #3
    Join Date
    Aug 2010
    Location
    Here and there
    Posts
    127
    Reputation
    28
    Thanks
    44
    Thanked 44 Times in 21 Posts

    Default Re: Blocking Google from crawling certain folder.

    Google respects robots.txt. Just write in that bots aren't allowed to access those pages.

  4. #4
    losille's Avatar
    losille is offline Registered Member
    Join Date
    Feb 2011
    Posts
    99
    Reputation
    24
    Thanks
    84
    Thanked 91 Times in 38 Posts

    Default Re: Blocking Google from crawling certain folder.

    Look over this page there a couple of ways. I use meta tag.
    Code:
    http://antezeta.com/news/avoid-search-engine-indexing

  5. #5
    typeslowly is offline Newbies
    Join Date
    Nov 2008
    Age
    90
    Posts
    23
    Reputation
    9
    Thanks
    3
    Thanked 3 Times in 3 Posts

    Default Re: Blocking Google from crawling certain folder.

    Quote Originally Posted by machines-in-motion View Post
    Google respects robots.txt. Just write in that bots aren't allowed to access those pages.
    This. But be aware some users will look at your robots.txt to try to find hidden shit.

Dot Gov Backlinks Sale


Smarter Submit

Similar Threads

  1. Google to sell domain names
    By Diamond Damien in forum Adsense
    Replies: 13
    Last Post: 02-15-2011, 12:43 PM
  2. Replies: 6
    Last Post: 07-08-2009, 10:31 AM
  3. Google Moves Checkout Promotion To Main Page
    By Diamond Damien in forum BlackHat Lounge
    Replies: 1
    Last Post: 02-06-2007, 08:26 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
  SEnukeX SEO Software
Proudly Powered by Hostwinds.com Web Hosting Click Here For Exclusive BHW Discounts!

Cheap Web Hosting


1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76