Via this offer — HostPenguin has got some cheap VPS starting at $6.95 for their Mini package.
75MB guaranteed memory (no burstable)
3GB storage
5GB/month data transfer
I think they are currently still on HyperVM (although the public access is likely to be disabled), but will be moving off to a new control panel as soon as possible. [...]