ARCollab: Towards Multi-User Interactive Cardiovascular Surgical Planning in Mobile Augmented Reality (2402.05075v1)
Abstract: Surgical planning for congenital heart diseases requires a collaborative approach, traditionally involving the 3D-printing of physical heart models for inspection by surgeons and cardiologists. Recent advancements in mobile augmented reality (AR) technologies have offered a promising alternative, noted for their ease-of-use and portability. Despite this progress, there remains a gap in research exploring the use of multi-user mobile AR environments for facilitating collaborative cardiovascular surgical planning. We are developing ARCollab, an iOS AR application designed to allow multiple surgeons and cardiologists to interact with patient-specific 3D heart models in a shared environment. ARCollab allows surgeons and cardiologists to import heart models, perform gestures to manipulate the heart, and collaborate with other users without having to produce a physical heart model. We are excited by the potential for ARCollab to make long-term real-world impact, thanks to the ubiquity of iOS devices that will allow for ARCollab's easy distribution, deployment and adoption.
- [n. d.]. ARSession.CollaborationData. https://developer.apple.com/documentation/arkit/arsession/collaborationdata
- Apple. 2013. Bonjour Concepts. (April 2013). https://developer.apple.com/library/archive/documentation/Cocoa/Conceptual/NetServices/Articles/about.html#//apple_ref/doc/uid/TP40002458-SW1
- Apple. 2024. Multipeer Connectivity. (2024). https://developer.apple.com/documentation/multipeerconnectivity
- Augmenting Coding: Augmented Reality for Learning Programming. In Proceedings of the Sixth International Symposium of Chinese CHI. ACM, Montreal QC Canada, 156–159. https://doi.org/10.1145/3202667.3202695
- Adaptive analysis & reconstruction of 3D DICOM images using enhancement based SBIR algorithm over MRI. Biomedical Research-tokyo 29 (2018), 644–653.
- A Critical Assessment of the Use of SSQ as a Measure of General Discomfort in VR Head-Mounted Displays. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1–14. https://doi.org/10.1145/3411764.3445361
- Three-dimensional-printed cardiac prototypes aid surgical decision-making and preoperative planning in selected cases of complex congenital heart diseases: Early experience and proof of concept in a resource-limited environment. Annals of Pediatric Cardiology 10 (2017), 117 – 125.
- Interactive Cardiovascular Surgical Planning via Augmented Reality. Asian CHI Symposium 2021 (2021).
- 3D-printed models optimize preoperative planning for pediatric cardiac tumor debulking. Translational Pediatrics 7, 3 (July 2018), 196–202. https://doi.org/10.21037/tp.2018.06.01
- A VR/AR Environment for Multi-User Liver Anatomy Education. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). 296–305. https://doi.org/10.1109/VR50410.2021.00052 ISSN: 2642-5254.
- Personalized Three-Dimensional Printed Models in Congenital Heart Disease. Journal of Clinical Medicine 8 (2019).
- Zhonghua Sun and Cleo Wee. 2022. 3D Printed Models in Cardiovascular Disease: An Exciting Future to Deliver Personalized Medicine. Micromachines 13, 10 (Oct. 2022), 1575. https://doi.org/10.3390/mi13101575 Number: 10 Publisher: Multidisciplinary Digital Publishing Institute.
- Evaluating Cardiovascular Surgical Planning in Mobile Augmented Reality. https://doi.org/10.48550/arXiv.2208.10639 arXiv:2208.10639 [cs].
- 3D Modeling and Printing in Congenital Heart Surgery: Entering the Stage of Maturation. Frontiers in Pediatrics 9 (2021). https://www.frontiersin.org/article/10.3389/fped.2021.621672
- A DirectX-Based DICOM Viewer for Multi-User Surgical Planning in Augmented Reality. http://arxiv.org/abs/2210.14349 arXiv:2210.14349 [cs].
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.