Over the past few decades, computer scientists have developed a wide array of models and approaches to analyze different aspects of human behaviour and communication, such as speech, emotions and gestures. Most existing techniques for hand gesture recognition rely on the use of wearable technologies with a single sensor and can only recognize a limited number of basic gestures.
Researchers at Comenius University Bratislava in Slovakia have recently developed WaveGlove, a new system for hand gesture recognition that utilizes multiple inertial sensors, instead of a single sensor. This new system is essentially a glove with an inertial sensor placed on each of its fingers.
“Our recent paper showcases the use of multiple inertial sensors for hand gesture recognition (HGR),” one of the researchers who carried out the study, told. “By building a custom hardware prototype and proposing a novel Transformer-based model (a network architecture, which had a lot of success on natural language processing tasks), we demonstrate that using multiple sensors can have a significant effect on the classification accuracy and allows for a richer vocabulary of gestures.”
Using WaveGlove, the hand gesture recognition system they created, the researchers were able to acquire two datasets containing over 11000 hand gesture samples. They then designed two different gesture vocabularies, one containing 8 whole-hand movements (WaveGlove-single) and another containing 10 more complex, carefully designed hand gestures, for which individual fingers move differently (WaveGlove-multi).
The presence of multiple sensors allows us to design and classify a richer vocabulary of gestures in comparison to single handheld sensors. Gestures we classify using multiple sensors are similar to those we already use in our daily lives. This makes the use of a device like WaveGlove easier and more natural.
In addition to compiling datasets of hand gestures and confirming the effectiveness of the WaveGlove system, the researchers benchmarked over 10 classification methods for hand gesture recognition, some of which they had developed as part of their previous research. They evaluated these methods on numerous different datasets, as they hoped that this would help to standardize results in the field of hand gesture recognition.
The findings gathered by this team of researchers could have numerous valuable implications. Firstly, their work could inform research focusing on hand gesture recognition and help to enhance existing systems. Secondly, the WaveGlove prototype they created could ultimately be used to improve communications between humans and machines, allowing the latter to better interpret human hand gestures.
