Data from one of the first clinical uses of augmented reality guidance with electromagnetically tracked tools shows that the technology may help doctors quickly, safely, and accurately deliver targeted liver cancer treatments, according to a research abstract presented during a virtual session of the Society of Interventional Radiology (SIR) 2020 Annual Scientific Meeting (Abstract 297). The technology provides a three-dimensional holographic view inside a patient’s body, allowing interventional radiologists to accurately burn away tumors while navigating to avoid organs and other critical structures.
“Converting traditional two-dimensional imaging into three-dimensional holograms which we can then utilize for guidance using augmented reality helps us to better view a patient’s internal structures as we navigate our way to the point of treatment,” said lead study author Gaurav Gadodia, MD, a radiology resident at Cleveland Clinic, in a statement. “While conventional imaging like ultrasound and computed tomography (CT) is safe, effective, and remains the gold standard of care, augmented reality potentially improves the visualization of the tumor and surrounding structures, increasing the speed of localization and improving the treating physician’s confidence.”
How the Technology Works
In this initial in-human pilot study, the technology was used to deliver percutaneous thermal ablation to solid liver tumors. To apply this technology, physicians use multiphase CT to record coordinate markers placed on a patient’s body. This imaging data is added to a software application that allows for segmentation of the tumor and nearby structures within the marked coordinate space. This information is fed into a proprietary augmented reality application, which utilizes Microsoft’s HoloLens technology—a virtual reality headset with transparent lenses—to project a segmented hologram of the patient’s imaged anatomy directly onto the patient. The hologram is registered to the coordinate markers to ensure accurate location of the relevant anatomy.
Utilizing electromagnetic tracking, instruments including the ablation probe can also be visualized in the augmented reality space during the procedure, thus allowing for true holographic intraprocedural guidance. Interventional radiologists can then use the combination of the holographic images of the patient’s anatomy and tracked tools to find the tumor in the patient’s liver quickly, check for optimal targeting of the tumor by the ablation probe, and avoid key structures.
Study Methods
The study included five patients who were selected for microwave ablation of their liver tumors. For safety during this institutional review board–approved study, the gold standard of ultrasound was used for primary clinical decision-making and probe guidance, with direct comparison to holographic guidance. Following ablation, images and video from postprocedural sonography, cone beam and multi-detector row CT, and HoloLens recordings were evaluated.
Findings
In all five cases, intraprocedural holographic guidance was in agreement with the standard ultrasound-based guidance. Postprocedural imaging showed adequate tumor ablation, and no patients experienced tumor recurrence at 3-month follow-up. In this early-phase pilot study, the authors anecdotally observed that the speed of tumor localization was faster with holographic guidance and that their confidence in optimal ablation and critical structure avoidance was improved over standard imaging guidance. They are further attempting to quantify these findings as they continue to enroll patients in the study.
Beyond its use during treatments, interventional radiologists also see value in using this tool for clinicians’ planning purposes and for improving patient engagement and understanding of the condition and treatment.
“This technique can be used intra-procedurally to check the accuracy and quality of the treatment, as well as preprocedurally to engage with the patient in their own care,” said senior study author Charles Martin, III, MD, FSIR, an interventional radiologist at Cleveland Clinic. “We can change two-dimensional images into holograms of a patient’s distinct anatomy so that both the physician and the patient get a better understanding of the tumor and treatment.”
Researchers continue to test this technology for ablations in the abdominal area with plans to expand to other types of procedures and in other areas of the body. The technology has only been tested for feasibility and therefore cannot yet be used as a stand-alone method for delivering a treatment.
Disclosure: This work was funded through internal enterprise grants from Cleveland Clinic, as well as the Ohio-based biotechnology start-up MediView.
