1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How do I block ahrefs from visiting a forum?

Discussion in 'Black Hat SEO' started by RuthSam, Feb 23, 2015.

  1. RuthSam

    RuthSam Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 19, 2010
    Messages:
    3,812
    Likes Received:
    973
    Gender:
    Male
    Home Page:
    Does anyone know how I can block all Ahrefs crawlers to visiting my clients forum?

    I know how to use htaccess, I just need to know what I need to blog to be 99% sure!
     
  2. ShahidMian

    ShahidMian Junior Member

    Joined:
    May 14, 2014
    Messages:
    114
    Likes Received:
    12
    Gender:
    Male
    I am not sure why you want this?
    Can you explain your question a bit so can be ans easily??
     
  3. RuthSam

    RuthSam Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 19, 2010
    Messages:
    3,812
    Likes Received:
    973
    Gender:
    Male
    Home Page:
    Well, your new to BHW, welcome to this awesome forum. Read a little more around and you will know it :)
     
  4. laur.laurix

    laur.laurix Power Member

    Joined:
    May 8, 2013
    Messages:
    592
    Likes Received:
    222
    Occupation:
    Reverse Engineering Maniac
    Location:
    Mars
    The safest way is the htaccess way. After intensive testing, u know hidding PBNs, i concluded that blocking ahrefs with htaccess is the best way.
     
  5. moanon

    moanon Registered Member

    Joined:
    Aug 30, 2014
    Messages:
    92
    Likes Received:
    37
    Location:
    near Vienna, Austria
    just add rel="nofollow" to your links.
    Or set up a redirect page on your site like /nofollowlink?url=[the_link_url], change the links and block /nofollowlink in your robots.txt

    just google "nofollow" and you'll get plenty of information on that topic ;)
     
  6. Jobdollarr

    Jobdollarr Supreme Member

    Joined:
    Dec 12, 2014
    Messages:
    1,405
    Likes Received:
    169
    Occupation:
    Webmaster
    Location:
    USA
    Home Page:
    Ip blocking them. I do not know how. But there must be a way for it
     
  7. laur.laurix

    laur.laurix Power Member

    Joined:
    May 8, 2013
    Messages:
    592
    Likes Received:
    222
    Occupation:
    Reverse Engineering Maniac
    Location:
    Mars
    :)) shut up Meg. Op is talking about ahrefs not G.

     
  8. RuthSam

    RuthSam Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 19, 2010
    Messages:
    3,812
    Likes Received:
    973
    Gender:
    Male
    Home Page:
  9. moanon

    moanon Registered Member

    Joined:
    Aug 30, 2014
    Messages:
    92
    Likes Received:
    37
    Location:
    near Vienna, Austria
    I guess Ahrefs uses an web crawler just like google and should follow the robots.txt rules when crawling the site.. but yeah could be that I misunterstood the question.

    By the way neither is my name Meg nor do I like to be told to shut up but I just guess it's an reference to Family Guy.. yeah good one.. because both names start with M or what? I don't really get it but I'm sure people not that stupid like me or Meg will get it ;)

    Sorry if I misunderstood the question, my answer was useless and I wasted your time. Just wanted to help..
     
  10. RuthSam

    RuthSam Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 19, 2010
    Messages:
    3,812
    Likes Received:
    973
    Gender:
    Male
    Home Page:
    :bsflag:you're trolling and don't even read the thread!
     
    • Thanks Thanks x 1
  11. moanon

    moanon Registered Member

    Joined:
    Aug 30, 2014
    Messages:
    92
    Likes Received:
    37
    Location:
    near Vienna, Austria
    Ok sorry if you think that.. Just saying that if you make a redirect page and block it with robots.txt it should have the effect you wanted because web crawlers (google ahrefs majestics whatever) should follow the rules in robots.txt and if you just link to "/nofollowlink?url=" ( [url] maybe encoded ) there is ...r time (and mine even more, genius) whatever
     
  12. watsonovedades

    watsonovedades Senior Member

    Joined:
    Mar 10, 2011
    Messages:
    922
    Likes Received:
    235
    Location:
    Mexico
  13. sergey007

    sergey007 Jr. VIP Jr. VIP

    Joined:
    Nov 13, 2014
    Messages:
    870
    Likes Received:
    327
    Location:
    pbn.rocks
  14. chickensalad

    chickensalad Registered Member

    Joined:
    Jun 11, 2014
    Messages:
    89
    Likes Received:
    24
    Location:
    UK
    Ahrefs are persistent - their bread and butter is crawling sites. I've never found a simple htaccess block ahrefs ua pls thx to work - they're possibly renaming their bot/IP ranges and sending them back out.

    Haven't heard of SpyderSpanker - but if they're constantly updating banned IP ranges, it's worth checking out.
     
  15. rogerke

    rogerke Regular Member

    Joined:
    Oct 5, 2014
    Messages:
    264
    Likes Received:
    145
    No, they aren't ;-)

    A simple .htaccess block/redirect code including ahrefsbot works just fine. It might be that you're using CCarter's code and although he's a straight genius, it's a wrong code for this purpose because it only blocks them from the homepage.
     
    • Thanks Thanks x 1
    Last edited: Feb 23, 2015
  16. chickensalad

    chickensalad Registered Member

    Joined:
    Jun 11, 2014
    Messages:
    89
    Likes Received:
    24
    Location:
    UK
    Lol, no way. What's the correct one?
     
  17. darkoltree

    darkoltree Junior Member

    Joined:
    Jul 19, 2013
    Messages:
    100
    Likes Received:
    11
    I know right. A lot of people these days commenting on the forums don't. You can see it for yourself. I'm disgusted.
     
  18. RuthSam

    RuthSam Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 19, 2010
    Messages:
    3,812
    Likes Received:
    973
    Gender:
    Male
    Home Page:
    Yeah, what is the correct code please?
     
  19. Silverbak

    Silverbak Junior Member

    Joined:
    Sep 29, 2014
    Messages:
    101
    Likes Received:
    69
    Jesus H. Christ, is this turning into the SEO section on Warrior Forum (where the blind leads the blind)? He's asking about blocking on a FORUM. So unless Ruth is running BBPress, SpyderSpanker aint gonna work cause it's a WORDPRESS plugin.
     
  20. RuthSam

    RuthSam Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 19, 2010
    Messages:
    3,812
    Likes Received:
    973
    Gender:
    Male
    Home Page:
    It's a Vbulletin Forum ! sp there is no wordpress or anything like that ;)