I would like the ability to have multiple screens for RDP without having to have them full-screen

It would be nice if I was able to RDP into a Windows machine where the client machine had multiple windows, and to be able to have the windows without them being full-screen. Is something like that even possible?