After some research on how the google see's my site, I dont think I am penalized.
site: gives ok results, backlinks are indexed, no safe problems by google, page rank the same = 3,
The top 3 sites for the keyword in question, have more backlinks, but the pages that are ranked higher than my...