To be honest, if it's not a really huge site with many categories you should be fine without any plugins that affects loading times. Just change the permalink structure to /%postname%/ and use common sense in h1 tags and good content and Wordpress is set for at least 90% of users.
Sometimes the plugins just makes it harder to edit since you have to edit on several places instead of just on the page.
If you use posts instead of pages, same goes jus remember to use tags but not excessive.
/ D