That's part of the process. Clearly what you were doing before worked. Just keep uploading. If your retention rate is high, and your browse feature CTR is good, then that means you're doing everything right. Just keep uploading and don't quit. If anything, look at it as a test from YouTube. The algorithm is probably like, "ah yes, lets mess with this dudes channel and lets see if he stays committed to uploading. If he quits, then we know he isn't the right asset to keep pushing on the algorithm."