1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

PBN - questions about crawlers and broken links

Discussion in 'Black Hat SEO' started by Regileo, Mar 11, 2017.

  1. Regileo

    Regileo Registered Member

    Joined:
    Jan 3, 2017
    Messages:
    64
    Likes Received:
    14
    Gender:
    Male
    Hi, I have few questions about PBN best practice,

    1. lots of guides suggests to block crawlers that arent google, to prevent sniffing. but on the other hand they mention that blocking crawlers is a foot print. So all in all, is it worth the advantages, to give google a footprint to recognize PBNs very easily if one update will start checking that?

    2. when buying an expired domain name, I assume that big part of its old backlinks were to internal pages on the site and not just the home page, what is the best practice in order to try and keep the site in a good health? how to forward all broken links to the home page or whatever is the suggestion? the default behavior is showing a broken link page, I'm not sure if that's the best practice.


    Thanks!
     
  2. The Data Scientist

    The Data Scientist Jr. VIP Jr. VIP

    Joined:
    Nov 3, 2016
    Messages:
    213
    Likes Received:
    56
    Gender:
    Male
    Occupation:
    Data Scientist, SEO & Entrepreneur
    Location:
    WWW
    The issue for Google is that legitimate sites are also blocking crawlers. Collateral damage is the issue.
     
    • Thanks Thanks x 1
  3. asap1

    asap1 BANNED BANNED Jr. VIP

    Joined:
    Mar 25, 2013
    Messages:
    4,961
    Likes Received:
    3,179
    1. No footprint.

    2. Dont 301 all 404's, thats a major footprint. Recreate the pages that have some links or dont buy domains with most of the links pointing to inner pages.
     
  4. SunnyLeon

    SunnyLeon Jr. VIP Jr. VIP

    Joined:
    Oct 13, 2013
    Messages:
    452
    Likes Received:
    171
    Gender:
    Male
    Location:
    Outside the Matrix
    .1 you don`t have to hide crawlers for the entire network and not even the same crawlers on all websites. That will take away some of the footprints.
    2. You can use a plugin to redirect 404 to home page to fix broken links :)
     
  5. asap1

    asap1 BANNED BANNED Jr. VIP

    Joined:
    Mar 25, 2013
    Messages:
    4,961
    Likes Received:
    3,179
    80% of deindexed blogs have 30% or more of all traffic redirected to homepage.
    90% of indexed blogs have less than 5% of all traffic redirected to homepage.

    https://blog.easyblognetworks.com/2015/causes-for-pbn-blogs-deindexation-backed-by-data/
     
  6. Nargil

    Nargil Jr. VIP Jr. VIP

    Joined:
    May 10, 2012
    Messages:
    3,945
    Likes Received:
    2,539
    Location:
    Europe
    Home Page:
    1. You don't have to block anything if you make your sites look perfectly real. Try to mix it up. Spend some more effort on a few domains, make them look super real and don't block crawlers (I know, easier said than done) and on the rest, block them. It's good to mix it up.

    2. I partially agree with Asap, it is a footprint to some extent, then again, that statistic from EBN may becaused by the fact, that people who do redirect stuff to homepage do so on all their domains and thus create a massive footprint. I believe that if you mix it up, you will do just fine. If 90%+ links point to homepage, then do nothing. If 50% links point to homepage, recreate the inner pages with the most links pointing to them. If only a few links point to homepage, use a redirect. This way, you will vary everything and should be, imo, footprintless.

    Then again, I have one theory that I haven't shared here regarding links pointing to inner pages. If the link points to your inner page, which is dead and you have no redirect set up, then it will either get redirected to domain.com/404 or stays at the same URL, depends how you have set it up. If the link points to dead inner URL and stays there without a redirect and, let's just say, that your page will show nothing except "nothing found here" for example, YET, your menus and sidebars will be visible, then the link juice should flow through the site no matter what. Not to mention, you can still mark these dead inner URLs as noindex, so your site isn't a mess and the linkjuice should still flow perfectly fine. HOWEVER, this is just a theory I came up with a few days back. Bottom line, you don't have to recreate the inner pages, just their URLs with "nothing found here" and top/sidebar/footer menu and setting them up as noindex. Somebody should really give this a shot. Big domains would be needed for this though.