I ran into this myself last year when my blog felt like it was stuck in quicksand. Cutting back on bulky plugins and compressing my images gave my load times a real shot in the arm. If you use tools like PageSpeed Insights, they're free and actually break down what bits of your site are dragging their feet, which makes fixes a lot less of a guessing game.