back Back

How to control a robot with your mind

May. 01, 2024.
1 min. read 5 Interactions

Deep-learning decoders improve a BCI’s performance, a step toward controlling a robot

About the writer

Amara Angelica

188.87299 MPXR

Co-lead author of a Frontiers of Neuroscience paper on future BCI-to-cloud devices

A typical BCI setup. The user is interacting with a computer and their intention is recorded from an EEG device and decoded (credit: Forenzo et al)

Brain-computer interfaces (BCIs) can make your life easier if you have movement or speech disorders. BCIs could als0 allow you to manipulate prosthetic limbs and use computers, and also play games.

And maybe one day you could control robots to do your bidding.

But unless you want to have an invasive Neuralink-type device drill into your brain (or via other methods), you’re currently stuck with wearing an EEG (electroencephalogram) device, like the guy above. Yes, it could analyze your brain waves, but for limited uses.

AI to the rescue

So Bin He in the Department of Biomedical Engineering at Carnegie Mellon University and colleagues turned to deep-learning decoders to hopefully improve a BCI’s performance.

The idea was to enable continuous and sustained movement of a virtual object. Twenty-eight adult participants were instructed to imagine moving their right hand to move the cursor right and their left hand to move the cursor left, moving both hands simultaneously to move upwards, and moving neither hand to go down.

The authors evaluated two different deep-learning architectures and a traditional decoder over seven BCI sessions.

A step towards neuro-assistive robotics

Both deep-learning decoders improved throughout the study and outperformed the traditional decoder by the final session.

The participants were able to control a fast, continuously moving computer cursor—tracking randomly moving objects with a high level of performance without moving a muscle.

Citation: Forenzo, D., Zhu, H., Shanahan, J., Lim, J., & He, B. (2024). Continuous tracking using deep learning-based decoding for noninvasive brain–computer interface. PNAS Nexus, 3(4). (open-access)

Let us know your thoughts! Sign up for a Mindplex account now, join our Telegram, or follow us on Twitter

Comment on this content


0 thoughts on “How to control a robot with your mind





💯 💘 😍 🎉 👏
🟨 😴 😡 🤮 💩

Here is where you pick your favorite article of the month. An article that collected the highest number of picks is dubbed "People's Choice". Our editors have their pick, and so do you. Read some of our other articles before you decide and click this button; you can only select one article every month.

People's Choice