One more alternative on the "admin a virtualized server" approach - I've been using Digital Ocean for about a year ( https://www.digitalocean.com/ ) to host a couple of small sites, and I'm generally a fan of their approach. Sort of like a slicker Linode, good community docs. Pricing starts at five bucks a month for a single "droplet".