AI-powered Brain Implant Reads Speech and Gestures Simultaneously
Researchers have developed a brain implant capable of simultaneously reading intended speech and gesture commands, translating them into text and avatar movements. Artificial intelligence addresses overlapping brain areas.
A brain implant can now, for the first time, read a paralyzed person's intended speech and gesture attempts simultaneously, translating them into text and the movements of a digital avatar, according to reporting by Fast Company. The device utilizes artificial intelligence (AI) to convert brain impulses into speech and body language, representing a significant advancement in brain-computer interfaces (BCI).
Previously, BCI systems could reliably decode only one type of output at a time, either speech or gestures. Challenges arose due to the partial overlap of brain areas involved in speaking and moving one's hands.
The new system, developed by researchers at the University of California, San Francisco (UCSF), processes speech and gestures together using AI. While the system's vocabulary is currently limited and its accuracy imperfect, it facilitates broader communication and interaction for individuals who have lost motor or speech function.
Lead researcher Samantha Brosler stated that the long-term goal is to develop a "whole-body BCI" capable of restoring multiple forms of communication and movement. The decoded signals could be used to control a virtual avatar, other assistive technologies, or even a physical robot surrogate, offering individuals with paralysis greater flexibility in interacting with the world.