VR dome for military performance analysis

http://www.army.mil/article/162899/Virtual_reality_dome_impact_of_real_life_scenarios_on_cognitive_abilities/

By Jane Benson, NSRDEC Public Affairs

NATICK, Mass. (Feb. 24, 2016) -- For researchers at the U.S. Army Natick Soldier Research, Development and Engineering Center (NSRDEC), there just may be no place like dome.

Thanks to its new virtual-reality dome, NSRDEC's Cognitive Science and Applications Team will be better able to study the impact of real-world operational situations on a Soldier's cognitive abilities and performance.

"The new VR laboratory will provide the Cognitive Science and Applications Team the ability to conduct research using more operationally relevant scenarios while still maintaining experimental control in our studies," said Dr. Caroline Mahoney, team leader for NSRDEC's Cognitive Science and Applications Team. "This capability brings our tightly controlled laboratory work one step closer to the field/operationally relevant environment."

The concave virtual-reality system provides a full 180-degree horizontal field and uses high-density, front-projection to create a high-resolution, visual world. The system enables participants to have immersive experiences in seamless virtual environments, which are modeled after real-world locations.

"This NSRDEC virtual reality capability affords novel applied, interdisciplinary science and technology activities that close traditional translational gaps between laboratory and field," Mahoney said. "The integration of multiple input modalities, along with multisensory feedback, increases the realism, immersion and engagement on behalf of users subjected to prolonged, workload-intensive activities.

"These novel integrations provide unprecedented opportunities to monitor and optimize human behavior during real-world task execution, and to evaluate and predict the impact of innovative human-systems technologies on operational performance."

In the virtual dome, users can interact and alter the environment through hand-held and weapon-based devices, which control movement, orientation and weapon aiming.

"Individual-level behavior can be elicited through immersive, scripted scenarios, and measured through location and orientation tracking, eye tracking, physiology and neurophysiology," Mahoney said.

The virtual dome will enable researchers to assess the impact of the environment on Soldier cognition, including decision-making, spatial memory or wayfinding. NSRDEC researchers will also be able to assess the impact of new equipment on cognitive abilities.

"For example, the Cognitive Science and Applications Team is currently working with Dr. Dave Darkow and the Mission Information Team to develop metrics for measuring cognitive workload during mission tasks and will use these tasks to measure the impact of new technology on Soldier cognition in operationally relevant environments," Mahoney said.

NSRDEC and outside equipment developers will eventually use the Cognitive Science Team's virtual dome data to aid in the design and development of Soldier technology and equipment.

In the future, additional and improved capabilities will be incorporated into the virtual dome. The future additions will include whole-body motion tracking, low-frequency vibration and directional wind. Vibro-tactile collision feedback -- which combines vibration and touch to help give participants a physical sense of constraints in a virtual environment -- will also be included.

"In the coming years, additional input modalities and multisensory feedback will be developed and integrated into the system to increase immersion," said Mahoney.

Overall, the dome will provide extensive new insights into the thinking processes of Soldiers in the field.

"Our new, virtual-reality capability provides unprecedented translational value to basic and applied cognitive sciences, allowing us to bridge the gap between highly controlled laboratory research and the inherent richness, dynamics and complexity of real-world Soldier experiences," said Dr. Tad Brunyé, a member of NSRDEC's Cognitive Science Team.

--------------------

The U.S. Army Natick Soldier Research, Development and Engineering Center is part of the U.S. Army Research, Development and Engineering Command, which has the mission to ensure decisive overmatch for unified land operations to empower the Army, the joint warfighter and our nation. RDECOM is a major subordinate command of the U.S. Army Materiel Command. 

--

http://www.defensetech.org/2016/03/18/virtual-reality-dome-to-assess-soldier-thinking-in-virtual-combat-environment/

Posted By: Bryant Jordan March 18, 2016

It’s not the Star Trek holodeck but a computer-generated reality “dome” in Massachusetts should immerse warfighters in a virtual environment that not only tests their skills, but allows Army researchers to assess soldier cognitive abilities.

The virtual reality dome is the creation of researchers at the U.S. Army Natick Soldier Research, Development and Engineering Center, where a Cognitive Science and Applications Team hopes to study the impact of real-world operational situations on decision-making, spatial memory and wayfinding.

The simulations will be modeled on real-world locations.

“The integration of multiple input modalities, along with multisensory feedback, increases the realism, immersion and engagement on behalf of users subjected to prolonged, workload-intensive activities,” cognitive science team leader Dr. Caroline Mahoney said.

The dome is a concave virtual-reality system that provides a full 180-degree horizontal field, using high-density, front-projection to create a high-resolution, visual world.

Other scientists at the Natick lab are developing metrics for measuring cognitive workload during mission tasks. This will enable researchers to assess how new equipment and technology born by soldiers effects their cognitive abilities, according to Mahoney.

The data from those measurements will eventually help in the design and development of soldier technology and equipment by center researchers and outside equipment manufacturers.

Down the road the lab will add to the dome’s capabilities. New features will include whole-body motion tracking, low-frequency vibration, directional wind and “vibro-tactile collision feedback” – merging vibration and touch to give participants a sense of physical constraint.

“In the coming years, additional input modalities and multisensory feedback will be developed and integrated into the system to increase immersion,” Mahoney said.

Bryant Jordan can be reached at bryant.jordan@military.com. Follow him on Twitter at @bryantjordan.