Bimanual Manipulation of Steady Hand Eye Robots with Adaptive Sclera Force Control: Cooperative vs. Teleoperation Strategies (2402.18088v2)
Abstract: Performing retinal vein cannulation (RVC) as a potential treatment for retinal vein occlusion (RVO) without the assistance of a surgical robotic system is very challenging to do safely. The main limitation is the physiological hand tremor of surgeons. Robot-assisted eye surgery technology may resolve the problems of hand tremors and fatigue and improve the safety and precision of RVC. The Steady-Hand Eye Robot (SHER) is an admittance-based robotic system that can filter out hand tremors and enables ophthalmologists to manipulate a surgical instrument inside the eye cooperatively. However, the admittance-based cooperative control mode does not safely minimize the contact force between the surgical instrument and the sclera to prevent tissue damage. Additionally, features like haptic feedback or hand motion scaling, which can improve the safety and precision of surgery, require a teleoperation control framework. This work presents a bimanual adaptive teleoperation (BMAT) control framework using SHER 2.0 and SHER 2.1 robotic systems. We integrate them with an adaptive force control (AFC) algorithm to automatically minimize the tool-sclera interaction force. The scleral forces are measured using two fiber Bragg grating (FBG)-based force-sensing tools. We compare the performance of the BMAT mode with a bimanual adaptive cooperative (BMAC) mode in a vessel-following experiment under a surgical microscope. Experimental results demonstrate the effectiveness of the proposed BMAT control framework in performing a safe bimanual telemanipulation of the eye without over-stretching it, even in the absence of registration between the two robots.
- P. Song, Y. Xu, M. Zha, Y. Zhang, and I. Rudan, “Global epidemiology of retinal vein occlusion: a systematic review and meta-analysis of prevalence, incidence, and risk factors,” Journal of global health, vol. 9, no. 1, 2019.
- K. Willekens, A. Gijbels, L. Schoevaerdts, L. Esteveny, T. Janssens, B. Jonckx, J. H. Feyen, C. Meers, D. Reynaerts, E. Vander Poorten et al., “Robot-assisted retinal vein cannulation in an in vivo porcine retinal vein occlusion model,” Acta ophthalmologica, vol. 95, no. 3, pp. 270–275, 2017.
- S. Singh and C. Riviere, “Physiological tremor amplitude during retinal microsurgery,” in Proceedings of the IEEE 28th Annual Northeast Bioengineering Conference (IEEE Cat. No. 02CH37342). IEEE, 2002, pp. 171–172.
- D. Goldenberg, J. Shahar, A. Loewenstein, and M. Goldstein, “Diameters of retinal blood vessels in a healthy cohort as measured by spectral domain optical coherence tomography,” Retina, vol. 33, no. 9, pp. 1888–1894, 2013.
- C. N. Riviere and P. S. Jensen, “A study of instrument motion in retinal microsurgery,” in Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No. 00CH37143), vol. 1. IEEE, 2000, pp. 59–60.
- B. Mitchell, J. Koo, I. Iordachita, P. Kazanzides, A. Kapoor, J. Handa, G. Hager, and R. Taylor, “Development and application of a new steady-hand manipulator for retinal surgery,” in Proceedings 2007 IEEE International Conference on Robotics and Automation. IEEE, 2007, pp. 623–629.
- A. Üneri, M. A. Balicki, J. Handa, P. Gehlbach, R. H. Taylor, and I. Iordachita, “New steady-hand eye robot with micro-force sensing for vitreoretinal surgery,” in 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics. IEEE, 2010, pp. 814–819.
- T. Meenink, G. Naus, M. de Smet, M. Beelen, and M. Steinbuch, “Robot assistance for micrometer precision in vitreoretinal surgery,” Investigative ophthalmology & visual science, vol. 54, no. 15, pp. 5808–5808, 2013.
- Y. Ida, N. Sugita, T. Ueta, Y. Tamaki, K. Tanimoto, and M. Mitsuishi, “Microsurgical robotic system for vitreoretinal surgery,” International journal of computer assisted radiology and surgery, vol. 7, pp. 27–34, 2012.
- M. A. Nasseri, M. Eder, S. Nair, E. Dean, M. Maier, D. Zapp, C. P. Lohmann, and A. Knoll, “The introduction of a new robot for assistance in ophthalmic surgery,” in 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 2013, pp. 5682–5685.
- E. Vander Poorten, C. N. Riviere, J. J. Abbott, C. Bergeles, M. A. Nasseri, J. U. Kang, R. Sznitman, K. Faridpooya, and I. Iordachita, “Robotic retinal surgery,” in Handbook of robotic and image-guided surgery. Elsevier, 2020, pp. 627–672.
- A. Ebrahimi, M. G. Urias, N. Patel, R. H. Taylor, P. Gehlbach, and I. Iordachita, “Adaptive control improves sclera force safety in robot-assisted eye surgery: A clinical study,” IEEE Transactions on Biomedical Engineering, vol. 68, no. 11, pp. 3356–3365, 2021.
- A. Ebrahimi, C. He, M. Roizenblatt, N. Patel, S. Sefati, P. Gehlbach, and I. Iordachita, “Real-time sclera force feedback for enabling safe robot-assisted vitreoretinal surgery,” in 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 2018, pp. 3650–3655.
- G. Amirkhani, A. Goodridge, M. Esfandiari, H. Phalen, J. H. Ma, I. Iordachita, and M. Armand, “Design and fabrication of a fiber bragg grating shape sensor for shape reconstruction of a continuum manipulator,” IEEE Sensors Journal, 2023.
- X. He, M. Balicki, P. Gehlbach, J. Handa, R. Taylor, and I. Iordachita, “A multi-function force sensing instrument for variable admittance robot control in retinal microsurgery,” in 2014 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2014, pp. 1411–1418.
- M. Esfandiari, J. W. Kim, B. Zhao, G. Amirkhani, M. Hadi, P. Gehlbach, R. H. Taylor, and I. Iordachita, “Cooperative vs. teleoperation control of the steady hand eye robot with adaptive sclera force control: A comparative study,” arXiv preprint arXiv:2312.01631, 2023.
- C. He, N. Patel, A. Ebrahimi, M. Kobilarov, and I. Iordachita, “Preliminary study of an rnn-based active interventional robotic system (airs) in retinal microsurgery,” International journal of computer assisted radiology and surgery, vol. 14, pp. 945–954, 2019.
- N. Patel, M. Urias, A. Ebrahimi, R. H. Taylor, P. Gehlbach, and I. Iordachita, “Force-based control for safe robot-assisted retinal interventions: In vivo evaluation in animal studies,” IEEE Transactions on Medical Robotics and Bionics, vol. 4, no. 3, pp. 578–587, 2022.
- C. He, E. Yang, and I. Iordachita, “Dual-stiffness force-sensing cannulation tool for retinal microsurgery,” in 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 2019, pp. 3212–3216.
- B. Zhao, M. Esfandiari, D. E. Usevitch, P. Gehlbach, and I. Iordachita, “Human-robot interaction in retinal surgery: A comparative study of serial and parallel cooperative robots,” arXiv preprint arXiv:2304.00213, 2023.
- C. M. Harris, A. O. Mitchell, and R. M. Laughlin, “Microvascular principles,” Atlas of Operative Oral and Maxillofacial Surgery, pp. 895–900, 2022.
- Mojtaba Esfandiari (13 papers)
- Peter Gehlbach (22 papers)
- Russell H. Taylor (55 papers)
- Iulian Iordachita (33 papers)