Maybe I'm missing something, but I think emulating a physical screen in a virtual field of view is the wrong way to do this. Why introduce off-axis viewing and all the other unnecessary weirdnesses? What if the entire field of view were the screen, with head and eye movement as navigation? I guess make the windows transparent so it's less disorienting, and it would at least initially be overwhelming, but past that it could be quite transformative.