the main things Id look at are uptime, support quality, server speed, renewal pricing, and how strict they are with random complaints or account flags. A lot of hosts look good on the sales page, but then the support is slow, uptime is mid, or they hit you with annoying limits later.
Cheap...