Can I start a Facebook page that is empty and just use ads to send clicks to a landing page?
Yes you can, the thing is if people like your page or sell it you are missing out on re-marketing to them for free.
Do I have to build a real FB page and account with followers and likes first?
You don't have to but it will help with credibility of your product/offer.
Also, can you just send FB ad clicks to an offer? Do they look down on that or ban it?
Depends on the offer, but if it is through a CPA network they will ban the URL, so you might want to research cloaking and other strategies.
All whitehat, I just want the traffic, I don't want any FB interaction.