It's starting to slow down
the website which it's annoying.
it looks like you've used some bloated plugins (JetPack, AIO SEO, etc), otherwise there's no reason for "some" plugins to slow your sites down. I have had many sites with 20-30 plugins installed without speed penalties, but it's true that I've also used caching plugins, CDNs, and optimization plugins like WP Rocket.
And I think I may have been lucky to find a good hosting company that doesn't have crappy servers
I think shared hosting is not necessarily bad, but I do think that it starts being bad after you reach a certain number of visitors per day ./ week as - at the end of the day - the resources provided to you with shared hosting are still limited despite of what the hosters advertise on their salespage. I have seen hosters throttling the resources many times for sites that have gotten big traffic consistently, so if you know that you'll have high amounts of traffic is better to simply get a VPS or WP hosting from the get-go and avoid potential headaches and / or traffic-related issues...
Personally, I've never used VPS or WP hosting, so I couldn't recommend anything, but I know that WPX (I believe that's how it's called) gets a lot of recommendations, so you might want to start with that one when looking for options...
As for VPS, I think Hetzner is at the top of their service, but I've heard that they're pretty restrictive with who they choose to do business with, so it might not work for you.... But there is also Vultr and DigitalOcean as options that pop up constantly on the forum, so these are 2 other possibilities you might want to look into...