I suspected thisFrom personal experience, losing subs does hurt channel, especially fake subs
I hope notI believe it will not hurt the ranking but it will eventually cause YouTube to realize that you are using fake subs and will terminate your account maybe?