Just don't be overly spammy and you should be fine. I get traffic using affiliate links and blogger, but I don't use them in every post. My home page, for example, is set to show my previous 5 - 10 posts (depending on the blog). Of those, maybe one or two use amazon links and I use the other three to build traffic and monitize with adsense.
