Please help me get started with self-hosted email

Hi guys...

I'm getting sick and tired of aweber and I've decided the time has come to move on to something I have more control over...

I want to set up a self-hosted email service... The only problem is that I have no idea on where to start

This is what I've understood so far:

I need a VPS
I need a email/autoresponder script
I need a SMTP service

I have read a lot and looked at a lot of VPS' but I have never used a VPS before, so I really don't know what to look for...

My dream scenario would be a all in one solution, where I pay a monthly fee and everything is sat up for me + I can do what I want

Can you guys help point me in the right direction...

googling is a good way to start. http://www.mailgun.com/pricing - seems good

Thanks guys... I consider myself a pretty good googler and I have actually spend a lot of time reading (and googling ). But that really helped. Thanks

Does anyone have experience with mailgun or no of any other servers?