Smithsonian Magazine · People & society

Brain Implant Enables Simultaneous Speech and Gesture Control of Virtual Avatar

Scientists developed a brain-computer interface allowing individuals with paralysis to control both speech and movement of a virtual avatar simultaneously.

The implant uses 253 electrodes on the sensorimotor cortex to decode thoughts for speech and gestures in real time.

The study involved two participants with paralysis (stroke and ALS). Researchers mapped brain activity to a digital avatar.

In tests, the avatar achieved 85% gesture and 75% phrase accuracy for the ALS participant. The stroke participant had 100% accuracy.

This technology could enhance communication and aid in controlling robotic prosthetics.

Limitations include lower speech decoding levels than some prior studies and decoding isolated actions, not continuous streams.

The work is a proof of concept; future plans include expanding vocabulary and continuous control of body parts.

AI-samenvatting op basis van de bron.