Meta Outlines Its Latest Advancements in Wrist Controller Inputs For AR and VR Interaction (19459000)
Meta’s wrist-detected controls, likely to be a major part of the upcoming AR and VR extensions, provided a peek into the future.
Meta has been developing a wrist-controller that relies on EMG to translate muscle movements into digital signals. It’s worked on it for a while and published its most recent research in Nature.
What could the basis of the next phase be?
Meta-explained:
” The teams at our company have created advanced machine-learning models capable of converting neural signals that control muscles in the wrist to commands that guide people’s interaction with devices. [AR] “Glasses eliminate the need for more traditional and cumbersome forms of input.”
The use of cameras and inertial sensors to detect brain activity can make it difficult to interact with the system.
EMG control is a minimally disruptive technology that aligns your natural body movements and behavior in a subtle manner.
Meta is now working to integrate this technology into their AR system.
” “You can send and type messages without using a keyboard. You can navigate menus without a computer mouse. And you will be able to see your surroundings as you interact with digital content, without looking down on your smartphone.”
Meta claims that the latest EMG controller can recognize your intention to perform various gestures. “Like tapping, swiping and pinching, all while your hand is comfortably resting at your side.”
It can even translate directly from handwriting.
The latest model of the company has shown solid results.
The sEMG models worked well for all people, without any person-specific calibration or training. Our sEMG RD platform performed well in open-loop evaluation (offline), achieving greater than 90% accuracy of classification for participants who were not present. The error was less than 13 degrees. -1 Error on wrist angle velocity decoding […] This is, to our knowledge the highest cross-participant level achieved with a neuromotor interfacing.”
Meta has not yet developed its AR glasses and no information is available on how they will be controlled. It’s becoming more and more apparent that a wrist-based control will be included in the Meta AR glasses package when it moves to the next phase of the project.
Meta’s current plan calls for it to start selling AR glasses in 2027. This is when Meta feels confident it can create fashionable, wearable AR glasses at a fair price.
With wrist control, we could be able to interact in a new way with digital media.
Mark Zuckerberg, CEO of Meta, has stated that smart glasses may eventually replace smartphones as the primary interactive surface.
Watch out for people wearing recording glasses and their hands twitching at their sides. This is the direction we are heading with wearable technology.