It would be difficult to remove unused CSS since it's one big file that covers many different pages (category page, post page, homepage, archives, tag page, widgets, etc.) I wouldn't recommend doing this unless you know exactly which rules will be unused.
As bobred pointed out in previous post, use a css compressor to get rid of unnecessary spaces and new lines. If you want to clean up unused rules because of the Google speed test tool, don't worry about it. Deleting couple of lines of "unnecessary" code won't make much difference.