Link or no link?

I'm making a very large local directory with over a thousand business listings, but I am wondering if I should put a link to the company's website on their listing. I may be confused, but I think I have heard that having a lot of outgoing links on your site is bad for SEO. I am experienced in SEO, but one are that I am ignorant on is outgoing links.