AWS by far is the most flexible hosting provider that I have seen. You can pretty much customize your server in any way. With that being said both with and without RDP, you could set up even a web control panel( you know the most common ones for windows I am not mentioning names so that it is not considered as advertisement.
But that is not the best part of it , AWS foundation lays in the ideology that you pay for what you use only and pay even less if you pay upfront. Now someone above also mentioned Digital Ocean - as far I as I am aware DO is built on top of AWS and they follow their ideology as well. However i find DO far more user friendly than AWS.
What I wanted to write to the OP in this prolonged post is that he can use Digital Ocean services for his web browsing need and create on the go virtualizations of windows - browse as much as he wish then he can simply destroy the image after he stops reading and he can repeat the process again when he wants to read next time. This way I believe he will be charged cents for the usage of the basic resources he needs. Same thing can happen with AWS as well it is just a little bit more configurations.