I used to have a couple of webhosting businesses years ago and my number one piece of advice is never, ever compete on price. If you think your VPS server is worth $10 then sell it for $10, don't undercut yourself to match someone else.
Think of something different to make the value of your product worth buying, aim at a certain niche of customer (look at what happened when Minecraft came out, a lot of MC hosts popped up and some made decent money - well when there weren't being DDoSsed out of existence!)
If you don't offer 24x7 support tell people, if you are a one man show don't pretend to be huge - people like honesty and some people (and this is my experience) prefer smaller companies as they get a more personalised service, not just a robotic underpaid level 1 outsourced tech getting paid pennies.
Don't do 'UNLIMITED' - there is no hope in hell you have unlimited diskspace, bandwidth, RAM etc - its just marketing BS that will bite you in the ass unless you are mega huge like GoDaddy of HostGator (but to be honest, look at those two companies, slowing circling the drain anyway......useless). Use realistic allowances, tell people why, tell people there is no unlimited in the world, honesty pays off in the end.
Do not scrimp on hardware, if you are renting dedis go with a decent company, don't pay rock bottom prices (pay peanuts, get monkies etc), if you are colo'ing, buy double the amount of kit, you know that PSU will blow at 3am one day!
Just a few things that may help you - thats before you get customers

If you want to chat feel free to get me on Skype - I am just getting ready to start again as well