I think the main problem here will be your anchor ratio. It was one of the targets of Penguin and I have seen these continuous drops as well on the sites, where my anchor ratio wasn't exactly amazing. If you anchor ratio sucks, it's best to dillute it. Don't necessarily have to be super amazing powerful links, but they need to get indexed. PBN links will also help for sure. Go for brand/URL anchors.