Oculus Rift continuity problem with hands/controller can be solved with...
The Power Glove !!!!!!
Slap a bunch of sensors on that thing, surround yourself with leap/other cameras, and go to town. We will need to come up with new methods of using abilities. It could some mix of hand gestures and actual game props like a gun if need be.
We can achieve the following:
I want to hold up the palm of my hand, and see this come out of it in a virtual world.
... Actually, that's not enough. We need a way to hook our own brains into a computer interface. I want my own thoughts to be able to manifest themselves in virtual reality: