When it comes to VPS's you get what you pay for. The $10 monthly wonders are mostly known to eBay and they are overused. You should be looking for a smaller, lesser known provider where the prices are high enough that they will stay in business.
If you know Linux, then you can get a fairly cheap VPS. If you need a Windows VPS, then you will have to pay more, since the VPS provider has to pay the license fee to Microsoft.
The problem with the $5 and $10 a month VPS's is that they tend to go out of business without warning. They also tend to change data centers abruptly, sometimes with no warning. So, your VPS which had an IP address in London suddenly starts showing up in Bangladesh. If that happens, you risk losing your accounts.
Also, VPS's in general are not ideal. If eBay/PayPal/Amazon knows you are using one, your account is toast. They figure you have something to hide. They CAN be used successfully, but it takes doing the legwork to get a good provider. Even then, sometimes accounts go down. The good thing is, as long as you are not locked into a contract, it is usually pretty easy to just use another provider and set up a new account if that happens.
 | 
In the previous post I gave you some reading to do.
