Swiss and Israeli scientists have created a new type of interface for VR. The new VR headset allows you to see the image in the palm of your hand as a controller. You can control elements of a VR application with simple gestures - turning your hand, pinching your fingers, etc.
The digital gloves are developed by a group of enthusiasts from the Swiss Higher Technical School of Zurich and Danielle Sisserman from Tel Aviv University. They proposed an interface for a VR headset that combines direct and remote exposure. The hand acts as a controller, and the application interface is projected onto the palm. Moreover, the hand model is created by the helmet cameras. The palm, in fact, replaces the smartphone.
Volunteers have already experienced the development and are generally pleased with the results. Only a few shortcomings were pointed out. So, in virtual reality, users see a schematic model of a hand, not their own. This reduces the degree of immersion in what is happening.
More about the interface
To demonstrate the capabilities of the interface, the developers created four prototype games. The interface is used in different scenarios, which can be seen using the HTC Vive VR headset with a Leap Motion controller . Several gestures are available for control.
First prototype. The palm turns into a pinball table. You can move the ball and collect points. Hand bends allow you to control the table tilt, thumb up triggers a new level, index and thumb in the OK position release a new ball.
Second prototype. The playing field moves along the hand, and the character stands in the center of the palm. By tilting your hand, you can protect it from falling into pits and other obstacles. Fireballs are activated with the thumb.
The third and fourth prototypes. Both hands are involved. Images of two different objects are projected onto the palm. You need to determine which one is easier, and lower your palm with this object down. The other, on the contrary, should be raised. In the next game, selection is made by flexing the fingers.
What's in AR?
Neural interfaces are popular among augmented reality developers. Similar, for example, is offered by Leap Motion. Their controller was used to test the interface in a VR headset. Unlike virtual reality, their interface complements the real world view. Augmented reality can be viewed through AR glasses or a smartphone screen.
Leap Motion has created an app that displays virtual wearables. They are activated when needed. For example, you can pull out a panel with buttons from your palm. The interface works thanks to glasses with a fixed sensor. The sensor monitors the position of the hands in real time, completely copying the limb, taking into account even small bends of the hands.
