Generally speaking...
It's your call if you want to delete the comments like: "follow for follow", "thanks for following... check out my page.." and stuff like that. Personally, I'd just keep them (assuming you have a decent amount of comments - it's just too much work). If you only have a handful, then I understand why it looks kind of bad (especially the "check out my page..." comments).
If the comment is clearly spam, go ahead and delete it.
If the comment is something generic like: "nice!" or "great share", just keep those.