1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Do you block link crawlers on your PBN?

Discussion in 'Black Hat SEO' started by MySeoEmail, Mar 30, 2016.

  1. MySeoEmail

    MySeoEmail Regular Member

    Joined:
    Mar 15, 2015
    Messages:
    227
    Likes Received:
    23
    Occupation:
    Business Owner
    Location:
    Denver, CO
    Just curious why someone would block link crawlers like Ahrefs etc for their PBN network? I have about 15 sites set up and I have not block not a one through hta access . To me block crawlers look very unnatural and suspicious. Am I wrong on this?
     
  2. BlackBDO

    BlackBDO Jr. VIP Jr. VIP

    Joined:
    Jan 4, 2016
    Messages:
    506
    Likes Received:
    319
    Because your competition can find them if you don't block those, and report them. Or find other websites of yours.
     
  3. SamyanDesigns

    SamyanDesigns Registered Member

    Joined:
    Sep 22, 2015
    Messages:
    93
    Likes Received:
    12
    Yes there are many footprints which people use to hide there pbn from search engines and competitors.
     
  4. jamie3000

    jamie3000 Supreme Member

    Joined:
    Jun 30, 2014
    Messages:
    1,371
    Likes Received:
    624
    Occupation:
    Finance coder looking for semi-retirement
    Location:
    uk
    Most people block them, mainly from fear of being reported to Google by competitors.
     
  5. BlackBDO

    BlackBDO Jr. VIP Jr. VIP

    Joined:
    Jan 4, 2016
    Messages:
    506
    Likes Received:
    319
    And then it's not a footprint, because you can block acces to your htaccess (or how it's called, I don't have pbn's, I know just the theory), so no one could see you are blocking ahrefs, etc...
     
  6. Keyser_Soze

    Keyser_Soze Newbie

    Joined:
    Nov 2, 2011
    Messages:
    27
    Likes Received:
    3
    BlackBDO and Jamie3000 are right...you pretty much can count on your competitors reporting you - it's business. All that effort down the drain...they can't report what they can't see.
     
  7. Devil Rider

    Devil Rider BANNED BANNED

    Joined:
    Jul 24, 2015
    Messages:
    554
    Likes Received:
    59
    In order to reduce the visibility of a backlink profile to competitors,
    hiding as much data as possible from these two tools if vital if you want to keep a competitive advantage towards the competition.
     
  8. jamie3000

    jamie3000 Supreme Member

    Joined:
    Jun 30, 2014
    Messages:
    1,371
    Likes Received:
    624
    Occupation:
    Finance coder looking for semi-retirement
    Location:
    uk
    There are sometimes ways around these blocks though, check our my signature. Its still in beta but worked well against my pbn ;-)
     
  9. accelerator_dd

    accelerator_dd Jr. VIP Jr. VIP

    Joined:
    May 14, 2010
    Messages:
    2,448
    Likes Received:
    1,010
    Occupation:
    SEO
    Location:
    IM Wonderland
    Yes, you are very wrong.

    Once you start ranking, you'll see your domains start deindexing from your competitors reporting them.

    No one knows if you've blocked the bots if you do it right (htaccess). The only way it will be a footprint is if you block them via robots.txt
     
  10. Cha Wong

    Cha Wong Regular Member

    Joined:
    Feb 1, 2016
    Messages:
    230
    Likes Received:
    10
    Occupation:
    SEO Expert & Social Media Marketer (Beginner)
    Location:
    Singapore
    Use robots.txt for this purpose
     
  11. Nerevar

    Nerevar Jr. VIP Jr. VIP

    Joined:
    Jun 30, 2010
    Messages:
    482
    Likes Received:
    180
    There's a free WP plugin for that Spider Blocker and it's been downloaded more than 7k times and it does not leave a footprint (responds with standard 404 error when pinged).
     
    • Thanks Thanks x 1
  12. MySeoEmail

    MySeoEmail Regular Member

    Joined:
    Mar 15, 2015
    Messages:
    227
    Likes Received:
    23
    Occupation:
    Business Owner
    Location:
    Denver, CO
    But if you can pass a manual inspection by Google why should you worry? You should build you PBN sites like money sites so when someone views them they dont know the difference. I spoke with someone from Google and they said sites that have Ahrefs and Majestic etc blocked is a huge red flag. If your PBN is set up appropriately and you link out to others and not just your site you should be fine in my opinion.
     
  13. seogiantking

    seogiantking Power Member

    Joined:
    Sep 19, 2015
    Messages:
    598
    Likes Received:
    100
    Gender:
    Male
    Location:
    Canada
    Home Page:
    Yes stop crawlers to crawl or use plugin to hide your pbn.
     
  14. MySeoEmail

    MySeoEmail Regular Member

    Joined:
    Mar 15, 2015
    Messages:
    227
    Likes Received:
    23
    Occupation:
    Business Owner
    Location:
    Denver, CO


    If you should block crawlers, which ones should be blocked?
     
  15. whiteblackseo

    whiteblackseo Jr. VIP Jr. VIP

    Joined:
    Apr 11, 2015
    Messages:
    2,490
    Likes Received:
    927
    Home Page:
    It's best to as it stops those prying eyes ;)
     
  16. MySeoEmail

    MySeoEmail Regular Member

    Joined:
    Mar 15, 2015
    Messages:
    227
    Likes Received:
    23
    Occupation:
    Business Owner
    Location:
    Denver, CO
    Also what should i copy and paste in my htaccess file? In other words what should it look like when I open it up?
     
  17. farrerob

    farrerob Newbie

    Joined:
    Apr 2, 2016
    Messages:
    7
    Likes Received:
    1
    Yes its absolutely important to block crawlers to your PBNs or even to your money sites.
     
  18. Furious Man

    Furious Man Jr. VIP Jr. VIP

    Joined:
    Aug 4, 2015
    Messages:
    1,737
    Likes Received:
    276
    hide your PBN with the plugin or stop crawlers to crawl
     
  19. Sristy

    Sristy Jr. VIP Jr. VIP Premium Member

    Joined:
    Aug 17, 2010
    Messages:
    1,824
    Likes Received:
    489
    Gender:
    Female
    Location:
    In My Blog Network
    Home Page:
    Whether natural or unnatural, if you don't block those backlink crawlers, you competition will come sniffing and they will sniff the stink of PBNs. Then all they have to do is reverse engineer it and add few more quality backlinks to their portfoio. BAM, you are no more ranking and we will have another whining thread on BHW.
     
  20. blogtaufiq

    blogtaufiq Junior Member

    Joined:
    Mar 22, 2011
    Messages:
    147
    Likes Received:
    10
    i block it via htaccess. how google know that we block ahref or majestic? so i think it's not a footprint