I'm thinking about how using a VR headset could create an immersive and possibly more intuitive work experience for those who use computers, particularly for graphic applications, but inclusive of common desktop apps.
Questions include:
- use of an AR headset with an option to isolate the view to the desktop
- question of keyboard use - does the user see a keyboard in the view or just rely on tactile feedback
- do applications require modifications to accommodate new ways of interaction - for example, gesture-based or glove-interface manual manipulation to replace mouse cursor input / control, keyboard shortcuts, etc.
- ergonomics of gesture interaction over time - body support for sustained use
Examples online:
Realistic hand control in VR:
Augment with gleechi for hand control and Manus VR or NeuroDigital's GloveOne for haptic feedback
http://www.roadtovr.com/virtualgrasp-aims-to-finally-deliver-realistic-hand-interactions-in-vr/?utm_source=Road+to+VR+Daily+News+Roundup&utm_campaign=4f98e3feec-RtoVR_RSS_Daily_Newsletter&utm_medium=email&utm_term=0_e2e394ad33-4f98e3feec-168175841
Virtual desktop - use of keyboard and mouse, replaces monitor with HTC Vive and Oculus headsets, running on Windows 10:
http://www.kotaku.com.au/2016/03/one-program-lets-you-use-your-entire-pc-in-vr-without-any-fuss/
Mouse replacement options, including brainwave input:
http://readwrite.com/2013/01/15/the-mouse-is-dead-long-live-tobii-leonard3do-leap-motion-oculus-vr/
http://www.theatlantic.com/technology/archive/2016/07/what-comes-after-keyboards/490511/