i really doubt google is actively trying to track connections between sites just to penalize them.
if someone owns two sites, one whitehat and one blackhat, why would google punish both? but if both are blackhat, then yeah, that’s a more solid reason for google to hit them together