Since VPS hosting is of hybrid nature which has the features from both Dedicated Hosting and Shared Hosting, it will let you have a low priced hosting. Since it has fewer sites running per server, you get better performance in comparison to shared hosting.
A few good VPS hosting services include -
1. InMotion VPS
The service is quite rich in features. It will let you have many free tools aiding in building your website.
2. Dreamhost VPS
Dreamhost has a good balance of features. But, it needs you have administrative knowledge of building a website. If you are a novice, or do not have requisite tools for building and migrating, I would not advice you to opt for it.
3. Hostgator VPS
The Hostgator packs in much of the tools needed. It lets you build an attractive website. But, interface is a little complicated. You may need to dig deeper to find what you need.
4. Hostwinds VPS
Hostwinds again is a feature packed option, but still it suffers from a few minor bugs.
Live....and Let Live!