back Back

Surgical robot trained with videos performs as well as human surgeons

Nov. 12, 2024.
2 mins. read. 16 Interactions

After learning to perform surgery by watching videos of experienced human surgeons, a robot performed as well as human surgeons.

About the Writer

Giulio Prisco

92.57456 MPXR

Giulio Prisco is Senior Editor at Mindplex. He is a science and technology writer mainly interested in fundamental science and space, cybernetics and AI, IT, VR, bio/nano, crypto technologies.

Credit: Mindplex

A robot has learned to perform surgery by watching videos of experienced human surgeons. This method, called imitation learning, allows the robot to copy the actions it sees without needing detailed programming for each step of the surgery. This development makes surgical robots more autonomous, meaning they can work on their own, reducing the need for direct human control.

The project was led by researchers from Johns Hopkins University and included Stanford University researchers. The researchers trained the robot to do three basic surgery tasks: moving a needle, lifting tissue, and stitching (video). The robot learned these skills by watching videos from wrist cameras, capturing how surgeons perform these tasks.

Imitation learning

Imitation learning is a type of machine learning where a system learns by observing examples. Here, the robot watched these surgical videos, which act like lessons or demonstrations for the robot.

The researchers used a model similar to the one used by ChatGPT, but instead of processing language, this model deals with kinematics, particularly how movements like bending and rotating are described mathematically.

With imitation learning, it is possible to train a robot much faster, in just a few days, to perform various surgeries.

The researchers trained the robot on hundreds of video clips. The robot learned not just to mimic but to adapt and perform tasks even when things didn’t go as planned, like if it dropped a needle.

This learning approach allowed the robot to perform these tasks as well as human surgeons, showing that it could adapt to new situations or errors during the surgery.

This breakthrough is significant because traditionally, programming a robot for surgery would take years for even one procedure. This could lead to fewer mistakes in surgery, more precise operations, and quicker training for new procedures.

The researchers presented their work at the Conference on Robot Learning, highlighting its importance in the fields of robotics and artificial intelligence for medical applications.

The team continues to work on making the robot capable of performing entire surgeries, not just individual tasks.

Let us know your thoughts! Sign up for a Mindplex account now, join our Telegram, or follow us on Twitter

Comment on this article

1 Comments

One thought on “Surgical robot trained with videos performs as well as human surgeons

  1. Incredible progress! Robots learning surgery from videos could transform precision and efficiency in medical procedures.

    1 Like
    Dislike
    Share
    Reply

10

Like

Dislike

Share

1

Comments
Reactions
💯 💘 😍 🎉 👏
🟨 😴 😡 🤮 💩

Here is where you pick your favorite article of the month. An article that collected the highest number of picks is dubbed "People's Choice". Our editors have their pick, and so do you. Read some of our other articles before you decide and click this button; you can only select one article every month.

People's Choice
Bookmarks