Depends on where you purchase your VPS's. If it's from a reputable seller, than yea.
As far as someone knowing your true IP? Just get a VPN (that doesn't save logs) and connect to the VPS that way; therefore, your true IP is never shown to the VPS- nor paypal (You -> VPN -> VPS -> paypal).
Just make sure when purchasing the VPS you use an anonymous form of payment- such as bitcoin.
That way even the HOSTER won't have the ability to trace you (unless you do something to allow that).