Update Nov 2009: “SupaVPS.com” is not resolving and could have been dead.
Discovered this provider today while browsing around. SupaVPS, a UK-based provider that has its domain registered for less than a month (although claiming to have several years of experience in their about page), is having some cheap < b>$4/month virtual servers.
64MB guaranteed/96MB burstable [...]