Accessibility links

Breaking News

Experimental Virtual and Mixed Reality Technologies Can be Applied to Military of the Future


A man dressed in Santa Claus clothes rides on a standup paddle board in Lebanon's northern coastal city of Batroun.
A man dressed in Santa Claus clothes rides on a standup paddle board in Lebanon's northern coastal city of Batroun.

In military training, the body and mind are often pushed to the limit. In some cases, it could prove to be deadly.

"We are killing more Marines and soldiers in training than in combat. Why does that happen? A lot of times it is fatigue," Lt. Col. Warren Cook of the U.S. Marine Corps said.

Cook spoke on a panel of military personnel at the University of Southern California's Global Body Computing Conference in Los Angeles. Commanding officers and scientists discussed the benefits of using technologies such as wearable sensors to help recruits be more aware of their body's limits so they can train better and safer.

WATCH: Experimental Virtual and Mixed Reality Technologies Can be Applied to Military of the Future

Experimental Virtual and Mixed Reality Technologies Can be Applied to Military of the Future
please wait

No media source currently available

0:00 0:02:51 0:00

"We are still in test-and-evaluation mode, so we have been testing ... most of what we have been testing are commercial products. We do have a suite of sensors that we have integrated into a system for physiological status monitoring to include the Zephyr heart monitor and a variety of other fundamental measures, but we have tested Fitbits," said chief scientist Charlene Mello with the U.S. Army Natick Soldier Research, Development and Engineering Center.

"How can we, through science and technology, generate lethality for the young Marine and sailor in a more efficient manner," Cook asked.

VR, augmented and mixed reality

Virtual reality, augmented reality and mixed reality projects are being developed that can have military applications. One mixed reality project at the University of Southern California Institute for Creative Technologies (USC ICT) involves drones small enough to fit in the palm of a hand. The drones can follow and capture a person's movements so they can be analyzed under a training simulation.

"When you combine performance capture that is autonomously driven with a lot of this biodata, it is going to change the way that athletes train. It is going to change the way that the military trains and operates, and it is going to change the way that we interact with the world," said Todd Richmond, director of Advanced Prototype Development at the University of Southern California Institute for Creative Technologies.

Another project at USC ICT is a virtual and augmented reality application called Monticello, where the user can interact with a virtual expert.

"If you are in a hostile environment and you have been trained to spot dangerous areas versus safe areas, you could use this augmented reality to perhaps take a picture of a corridor or an area that you are currently occupying, and a virtual expert could mark on the application dangerous areas vs. safe areas where you could place yourself," Adam Reilly, USC ICT's research programmer said.

Another USC ICT project is called Bystander, a virtual reality prototype that helps people prevent sexual harassment and assault.

"The military is very interested in this area of research because they have programs already to try and mitigate sexual assaults, sexual harassment. It's a big problem in the military," said David Nelson, project manager of USC's Mixed Reality Lab and creative director of the Mixed Reality Studio.

Nelson said taking an online course on mitigating sexual harassment and assault is different than a fully immersive experience where the student user can see something happening and try to physically stop it.

"We believe that's a really different experience if you immerse somebody in a situation because you can read a story and say, 'Well, this is how I would react or this is how I would act in that circumstance' but until you're actually in it, you really don't know how you would behave. So the goal of this project was to really try and foster more active bystander participation," Nelson said.

Commanding officers and scientists at the University of Southern California's Global Body Computing Conference agreed that technology can be useful in keeping servicemen and women mentally and physically healthy, which can translate to better performance in combat.

"If you're trained well, you will behave well in combat," Col. Jeffrey Holt of the U.S. Marine Corps said.

XS
SM
MD
LG