1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How many normal sites (money sites) block majestic / ahrefs?

Discussion in 'Black Hat SEO' started by codeman1234, Apr 27, 2016.

  1. codeman1234

    codeman1234 Power Member

    Joined:
    Sep 13, 2011
    Messages:
    612
    Likes Received:
    51
    Hello everyone,

    I been blocking majestic and ahrefs (and most SEO bots) in a bunch of PBN?s and they work great currently, I am not disputing that.

    But my question is very simple is it normal on Google's eyes to block majestic / ahrefs and most SEO software bots on your money site? Or this goes against Google guidelines?

    Personally in PBN's this works like a charm that is why I don't see this as an issue and that is why I am wondering if anyone has done this.

    Waiting for your opinions, thanks guys and girls!
     
  2. ThopHayt

    ThopHayt Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 25, 2011
    Messages:
    6,343
    Likes Received:
    2,284
    I have mixed feeling on the subject. I can see some good justification on PBNs, but on a money site it shouldn't be needed really. Looks shady frankly.
     
    • Thanks Thanks x 1
  3. codeman1234

    codeman1234 Power Member

    Joined:
    Sep 13, 2011
    Messages:
    612
    Likes Received:
    51
    Hey ThopHaypt,

    Thanks for the reply, yeah me too is an odd subject since most people have mixed feelings on the matter however, I see your point but, makes me wonder if is really a problem because if so, then the option would not exist or even google would say something about it and maybe I missed it but, I never read anything about Google been against blocking bots.

    What you guys think?
     
  4. LockerWizPro

    LockerWizPro Jr. VIP Jr. VIP

    Joined:
    Aug 10, 2010
    Messages:
    132
    Likes Received:
    204
    Personally I don't think that Google minds this. It even suggests you use a .robots to block it's own bot from places you don't like. It's kind of like in court.. someone might look guilty because they're not talking at all but that doesn't mean that they are guilty, and they can't be deemed guilty because of it. That's my philosophy.
     
    • Thanks Thanks x 1
  5. Ste Fishkin

    Ste Fishkin Jr. VIP Jr. VIP Premium Member

    Joined:
    May 14, 2011
    Messages:
    2,047
    Likes Received:
    10,418
    I doubt it makes a difference...
     
    • Thanks Thanks x 1
  6. agent-x

    agent-x Junior Member

    Joined:
    Apr 4, 2012
    Messages:
    173
    Likes Received:
    34
    Gender:
    Male
    I actually did used to block them in htaccess along with a load of other user agents simply because they kept crawling the same pages over and over again and I didn't know what they were. I still as a rule block any bot that I can't see a benefit in allowing it to crawl my pages.
     
    • Thanks Thanks x 1
  7. codeman1234

    codeman1234 Power Member

    Joined:
    Sep 13, 2011
    Messages:
    612
    Likes Received:
    51
    Yes, I think the same because if it was not allowed then Google would say something about it or even worst wont be allowed to do.

    But, I just want to confirm, does anyone else block bots on money site?
     
  8. accelerator_dd

    accelerator_dd Jr. VIP Jr. VIP

    Joined:
    May 14, 2010
    Messages:
    2,448
    Likes Received:
    1,009
    Occupation:
    SEO
    Location:
    IM Wonderland
    If you block them the right way, Google won't have a clue what you've blocked - htaccess file. If you do it via robots.txt, you are putting the info out there for everyone.
     
    • Thanks Thanks x 1
  9. discmartin

    discmartin Registered Member

    Joined:
    Sep 29, 2013
    Messages:
    70
    Likes Received:
    24
    I blocked those bots on money sites because they are consuming my bandwidth. I get nothing from them in return.
     
    • Thanks Thanks x 1
  10. codeman1234

    codeman1234 Power Member

    Joined:
    Sep 13, 2011
    Messages:
    612
    Likes Received:
    51
    But, guys does blocking bots matters at all to Google even if you have Google Adsense on your money site? anyone doing that or did that?
     
  11. codeman1234

    codeman1234 Power Member

    Joined:
    Sep 13, 2011
    Messages:
    612
    Likes Received:
    51
    Any opinions on if matters if you have adsense?? Also what about blocking archive.org bot, what you guys think? And is there any difference of using spyderspanker or htaccess?

    Thanks!
     
    Last edited: Apr 29, 2016