1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to forbid Majestic and other bots visits my site?

Discussion in 'Black Hat SEO' started by culling, Sep 11, 2016.

  1. culling

    culling Registered Member

    Joined:
    Apr 7, 2016
    Messages:
    79
    Likes Received:
    5
    As above, how can forbid this kind of bots from visit my PBN?
     
  2. kyoka12

    kyoka12 Junior Member

    Joined:
    Jul 10, 2014
    Messages:
    152
    Likes Received:
    38
    Occupation:
    Nothing!
    Location:
    Macau
  3. culling

    culling Registered Member

    Joined:
    Apr 7, 2016
    Messages:
    79
    Likes Received:
    5
    Yes I did some research but I found only old threads...
    Is the method in that thread still good in 2016?
     
  4. SEOplusplus

    SEOplusplus Registered Member

    Joined:
    Sep 11, 2016
    Messages:
    68
    Likes Received:
    11
    Gender:
    Male
    use some htaccess codes to do this,
     
  5. lawlesova

    lawlesova BANNED BANNED

    Joined:
    Feb 18, 2012
    Messages:
    50
    Likes Received:
    8
    Webmaster tools and disavow.
     
  6. Xlr8

    Xlr8 BANNED BANNED Jr. VIP

    Joined:
    Oct 17, 2014
    Messages:
    430
    Likes Received:
    174
    Wut? Did you even read the question?
     
  7. lawlesova

    lawlesova BANNED BANNED

    Joined:
    Feb 18, 2012
    Messages:
    50
    Likes Received:
    8
    yes you dont want bots to crawl your website so dont allow them to by editing robots txt and blocking said sites on google webmaster tools? WUT?
     
  8. Xlr8

    Xlr8 BANNED BANNED Jr. VIP

    Joined:
    Oct 17, 2014
    Messages:
    430
    Likes Received:
    174
    I don't know if it's even possible to block bots using WMT but even if that's possible you'd be a fool to do so.

    And how do you disavow a bot anyway? lol

     
  9. lawlesova

    lawlesova BANNED BANNED

    Joined:
    Feb 18, 2012
    Messages:
    50
    Likes Received:
    8
    ip filtering? you can get daily lists of bots for this purpose.
     
  10. ugjunk

    ugjunk Jr. VIP Jr. VIP

    Joined:
    Jan 1, 2011
    Messages:
    2,540
    Likes Received:
    740
    Location:
    Los Angeles
    Home Page:
    Add these in your Robots.txt file:


    User-agent: MJ12bot
    Disallow: /
    User-agent: SemrushBot
    Disallow: /
    User-agent: SemrushBot-SA
    Disallow: /
    User-agent: rogerbot
    Disallow:/
    User-agent: dotbot
    Disallow:/
    User-agent: AhrefsBot
    Disallow: /
    User-agent: Alexibot
    Disallow: /
    User-agent: SurveyBot
    Disallow: /
    User-agent: Xenu’s
    Disallow: /
    User-agent: Xenu’s Link Sleuth 1.1c
    Disallow: /

    Source: https://gopbn.com/blog/private-blog-network/
     
    • Thanks Thanks x 1
  11. T2tkid

    T2tkid Elite Member

    Joined:
    Oct 13, 2010
    Messages:
    3,826
    Likes Received:
    1,745
    I don't think it is possible. Block bots using WMT? What happen to SEO?