Mixed Reality for Cranial Neurosurgical Planning

Operative Neurosurgery 26:551–558, 2024

Mixed reality (MxR) benefits neurosurgery by improving anatomic visualization, surgical planning and training. We aim to validate the usability of a dedicated certified system for this purpose.

METHODS: All cases prepared with MxR in our center in 2022 were prospectively collected. Holographic rendering was achieved using an incorporated fully automatic algorithm in the MxR application, combined with contrast-based semiautomatic rendering and/or manual segmentation where necessary. Hologram segmentation times were documented. Visualization during surgical preparation (defined as the interval between finalized anesthesiological induction and sterile draping) was performed using MxR glasses and direct streaming to a side screen. Surgical preparation times were compared with a matched historical cohort of 2021. Modifications of the surgical approach after 3-dimensional (3D) visualization were noted. Usability was assessed by evaluating 7 neurosurgeons with more than 3 months of experience with the system using a Usefulness, Satisfaction and Ease of use (USE) questionnaire.

RESULTS: One hundred-seven neurosurgical cases prepared with a 3D hologram were collected. Surgical indications were oncologic (63/107, 59%), cerebrovascular (27/107, 25%), and carotid endarterectomy (17/107, 16%). Mean hologram segmentation time was 39.4 ± 20.4 minutes. Average surgical preparation time was 48.0 ± 17.3 minutes for MxR cases vs 52 ± 17 minutes in the matched 2021 cohort without MxR (mean difference 4, 95% CI 1.7527-9.7527). Based on the 3D hologram, the surgical approach was modified in 3 cases. Good usability was found by 57% of the users.

CONCLUSION: The perioperative use of 3D holograms improved direct anatomic visualization while not significantly increasing intraoperative surgical preparation time. Usability of the system was adequate. Further technological development is necessary to improve the automatic algorithms and reduce the preparation time by circumventing manual and semiautomatic segmentation. Future studies should focus on quantifying the potential benefits in teaching, training, and the impact on surgical and functional outcomes.

Data fusion and 3D visualization for optimized representation of neurovascular relationships in the posterior fossa

Acta Neurochirurgica (2022) 164:2141–2151

Reliable 3D visualization of neurovascular relationships in the posterior fossa at the surface of the brainstem is still critical due to artifacts of imaging. To assess neurovascular compression syndromes more reliably, a new approach of 3D visualization based on registration and fusion of high-resolution MR data is presented.

Methods A total of 80 patients received MRI data with 3D-CISS and 3D-TOF at 3.0 Tesla. After registration and subsequent segmentation, the vascular information of the TOF data was fused into the CISS data. Two 3D visualizations were created for each patient, one before and one after fusion, which were verified with the intraoperative situation during microvascular decompression (MVD). The reproduction quality of vessels was evaluated with a rating system.

Results In all cases, the presented approach compensated for typical limitations in the 3D visualization of neurovascular compression such as the partial or complete suppression of larger vessels, suppression of smaller vessels at the CSF margin, and artifacts from heart pulsation. In more than 95% of the cases of hemifacial spasm and glossopharyngeal neuralgia, accurate assessment of the compression was only possible after registration and fusion. In more than 50% of the cases with trigeminal neuralgia, the presented approach was crucial to finding the actually offending vessel.

Conclusions 3D visualization of fused image data allows for a more complete representation of the vessel-nerve situation. The results from this approach are reproducible and the assessment of neurovascular compression is safer. It is a powerful tool for planning MVD.