1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Blocking robots on money site?

Discussion in 'Black Hat SEO' started by codeman1234, Apr 6, 2016.

  1. codeman1234

    codeman1234 Power Member

    Joined:
    Sep 13, 2011
    Messages:
    645
    Likes Received:
    54
    Hello guys,

    I got a question, does anyone blocks robots on money site? In case you want to hide some backlinks you don't control from competitors? Or what is the best way to do this? Since it feels odd to block robots on money site? What you guys think?

    Thanks
     
  2. codeman1234

    codeman1234 Power Member

    Joined:
    Sep 13, 2011
    Messages:
    645
    Likes Received:
    54
    Hello Xdurance,

    Thanks for the reply but, you misunderstood me or I did not explain correctly, what I mean is that there some links on the backlinks profile of one money site I want to hide from competitors to avoid them to copy my way of getting this links, what is my only option to block robots? is this right to do on money site?

    Thanks!
     
  3. qrazy

    qrazy Senior Member

    Joined:
    Mar 19, 2012
    Messages:
    1,115
    Likes Received:
    1,725
    Location:
    Banana Republic
    Most of these SEO related bots will just ignore the robots.txt, so you might need to block them by useragent/IP in htaccess file.
     
  4. codeman1234

    codeman1234 Power Member

    Joined:
    Sep 13, 2011
    Messages:
    645
    Likes Received:
    54

    Hey Grazy,

    Thanks for the reply! Yes, I know how to block them on htaccess that is not the issue my question is basically if is recommended to block bots on money sites? and if there is other more recommended way to do this so it does not looks odd to Google?

    Thanks!
     
  5. qrazy

    qrazy Senior Member

    Joined:
    Mar 19, 2012
    Messages:
    1,115
    Likes Received:
    1,725
    Location:
    Banana Republic
    I don't know of any other methods to block these bots than htaccess/robot. And if you do it via htaccess, only your server would know about the rule/condition, not google or anyone else.
     
  6. codeman1234

    codeman1234 Power Member

    Joined:
    Sep 13, 2011
    Messages:
    645
    Likes Received:
    54
    Question still remains, what I mean is does it look unnatural for Google for a site to block bots?


    Thanks!
     
  7. qrazy

    qrazy Senior Member

    Joined:
    Mar 19, 2012
    Messages:
    1,115
    Likes Received:
    1,725
    Location:
    Banana Republic
    As I mentioned, If you do it via htaccess, google will have no idea whether you blocked any of the other bots or not, So logically it shouldn't have any (+ve or -ve) impact at all.
     
  8. blogtaufiq

    blogtaufiq Junior Member

    Joined:
    Mar 22, 2011
    Messages:
    149
    Likes Received:
    10
  9. Nicheblogger

    Nicheblogger Regular Member

    Joined:
    Apr 29, 2014
    Messages:
    286
    Likes Received:
    189
    Blocking crawlers on your money site is pointless. You would need to block crawling on the site that links to your money site to get the effect you seem to be looking for.
     
    • Thanks Thanks x 1
  10. Furious Man

    Furious Man Jr. VIP Jr. VIP

    Joined:
    Aug 4, 2015
    Messages:
    1,929
    Likes Received:
    314
    spiderblocker ill help you u can try that one