A System for Robotic Heart Surgery that Learns to Tie Knots Using Recurrent Neural Networks

Abstract— Tying suture knots is a time-consuming task performed frequently during Minimally Invasive Surgery (MIS). Automating this task could greatly reduce total surgery time for patients. Current solutions to this problem replay manually programmed trajectories, but a more general and robust approach is to use supervised machine learning to smooth surgeongiven training trajectories and generalize from them. Since knottying generally requires a controller with internal memory to distinguish between identical inputs that require different actions at different points along a trajectory, it would be impossible to teach the system using traditional feedforward neural nets or support vector machines. Instead we exploit more powerful, recurrent neural networks (RNNs) with adaptive internal states. Results obtained using LSTM RNNs trained by the recent Evolino algorithm show that this approach can significantly increase the efficiency of suture knot tying in MIS over preprogrammed contr...

• Type: Conference
• Year: 2006
• Where: IROS
• Authors: Hermann Georg Mayer, Faustino J. Gomez, Daan Wierstra, Istvan Nagy, Alois Knoll, Jürgen Schmidhuber
• Keywords: Feedforward Neural Nets, IROS 2006, Minimally Invasive Surgery, Robotics, Suture Knot