inactivated: no, not the front end. They might slow down the back end, but that's just theoratically since you wouldn't notice it (some exceptions maybe)
activated: normally no, but depends greatly on the plugin and what it does/has to load of course..