Your adult followers probably won't convert well to fitness niche (just me guessing though).
I think you should keep the adult account going and do your best to monetize it.
Slowly build up a fitness account on the side and then you can use your adult account to shout it out.
Use the same methods you used to build your adult account on top of that.
This way you get targeted followers who will convert.