back Back

Robots learn better by also listening

Jul. 04, 2024.
1 min. read. 1 Interactions

Stanford researchers find improved robot training by adding audio

About the writer

Amara Angelica

217.83675 MPXR

Audio engineer/electronic musician

Adding a microphone to teach robotic arm to better execute a task (credit: Zeyi Liu)

For robots to move into homes, they’ll need to learn to listen, suggests MIT Technology Review.

“Researchers at the Robotics and Embodied AI Lab at Stanford University have built a system for collecting audio data, consisting of a GoPro camera and a gripper with a microphone.

“Thus far, robots have been training on videos that are muted,” says Zeyi Liu, a PhD student at Stanford and lead author of the study. “But there is so much helpful data in audio.”

The results, published in a paper on arXiv: “When using vision alone in the dice test, the robot could tell 27% of the time if there were dice in the cup, but that rose to 94% when sound was included.”

Citation: Zeyi Liu et al. ManiWAV: Learning Robot Manipulation from
In-the-Wild Audio-Visual Data. arXiv https://arxiv.org/pdf/2406.19464 (open access)

Let us know your thoughts! Sign up for a Mindplex account now, join our Telegram, or follow us on Twitter

Comment on this content

1 Comments

One thought on “Robots learn better by also listening

  1. The integration of auditory learning in robots is a fascinating development that opens new possibilities for AI. By incorporating listening capabilities, robots can better understand their environment and interact more naturally with humans. This advancement could lead to significant improvements in areas like customer service, healthcare, and even personal assistants, where nuanced understanding and responsive communication are crucial. The article highlights how this technology could also enhance machine learning processes, making AI systems more adaptive and efficient. It's exciting to see how these innovations will shape the future of human-robot interactions.

    Like
    Dislike
    Share
    Reply

Like

Dislike

Share

1

Comments
Reactions
💯 💘 😍 🎉 👏
🟨 😴 😡 🤮 💩

Here is where you pick your favorite article of the month. An article that collected the highest number of picks is dubbed "People's Choice". Our editors have their pick, and so do you. Read some of our other articles before you decide and click this button; you can only select one article every month.

People's Choice
Bookmarks