I want to call out one thing in case you didn't know.
The idea of a public VPN is to hide your traffic with other users who also use the VPN. If you're renting a VPS you don't get all the "benefits" of a public VPN. All you're doing is adding an extra hop to the internet, you're not mixing your traffic with others using the same IP. It's all you.... In fact, you're probably making it easier to isolate the things you do online because at home you could say a guest you had over must have downloaded it. If its the VPS, its all you.
Why use a VPS at all then? Do you not want to host at home?