Transforming Neurosurgery With Spatial Computing: Enhancing Intraoperative Visualization and Precision Through Augmented Reality

Operative Neurosurgery 30:760–764, 2026

This technical note reports three neurosurgical cases using the Medivis surgical augmented reality platform with the Microsoft HoloLens 2 to overlay real-time 3D imaging, exoscopic, and endoscopic outputs intraoperatively. The workflow, registration method, hardware and software integration, and case-specific operative details are described, with all patients recovering without complications.

The report evaluates benefits and limitations of wearable XR in the operating room, highlighting improved visualization, surgical precision, and ergonomics, while addressing challenges such as registration accuracy, latency, cognitive overload, and avenues for future hardware and software improvements.

Goal Integrate wearable XR/AR and spatial computing into neurosurgical operating rooms to enhance intraoperative visualization, precision, and ergonomics.

System setup Three neurosurgical cases used the Medivis SurgicalAR platform paired with a Microsoft HoloLens 2 worn by the primary surgeon, enabling overlay of 3D volumes and intraoperative video in the surgeon’s field of view.

Imaging workflow Preoperative CT/MRI (including tractography/connectomic imaging when available) were uploaded from PACS, processed quickly (windowing/coloring/cropping/brightening), and stored for OR use, then linked to the HoloLens.

Registration approach Intraoperative holographic point-matching registration matched physical landmarks on the patient to virtual fiducials via an optical localizer recognized by HoloLens 2, with an FDA-approved navigation system also used in all cases for confirmation.

Video integration Exoscopic/endoscopic outputs were captured and streamed to the AR computer and transmitted to the HoloLens for real-time manipulation and interaction by the surgeon.

Observed benefits Combined overlays improved visualization and supported ergonomic operating posture, optimized sight lines, and reduced OR footprint while maintaining standard team visualization via the exoscope monitor.

Case outcomes All three patients recovered well postoperatively without complications; no critical intraoperative issues from latency/dropped frames prevented procedure completion.

Limitations & next steps Key challenges include potential cognitive overload/inattentional blindness, hologram registration accuracy, and technical issues like latency/dropped frames; future work targets improved/universal registration and broader overlayable data streams (e.g., conferencing, checklists).

Disruptive technologies in spine surgery: current trends, outcomes, and ethical implications

J Neurosurg Spine 44:756–768, 2026

Disruptive technologies in spine surgery—AR/VR, robotics, neuronavigation, endoscopy, and patient-specific implants—are examined for their roles in enhancing precision, training, and patient outcomes. The review summarizes evidence for preoperative simulation, AR-assisted planning, and 3D segmentation, highlighting improvements in accuracy, reduced fluoroscopy, and trainee confidence.

Intraoperative advances such as robot-assisted techniques, computer-assisted navigation, and endoscopic approaches offer minimally invasive alternatives with favorable recovery profiles but face challenges of cost, learning curves, and equitable access. The authors emphasize ethical considerations, need for standardized outcomes, and strategies to expand accessibility and training.

Scope Disruptive spine-surgery technologies emphasized include AR/VR (XR), advanced navigation, robotics, patient-specific implants/3D printing, and endoscopic spine surgery.

XR definitions VR provides a fully immersive digital environment, AR overlays digital content onto the real world, and MR blends both; all fall under XR.

Training impact VR simulation in spine training improved trainee comfort and autonomy and reduced fluoroscopy use in lateral lumbar interbody fusion simulations; VR-trained learners also made fewer pedicle-screw placement errors than traditional instruction.

Preop planning VR-based planning can reduce fluoroscopy/localization time and improve puncture accuracy in endoscopic lumbar discectomy; segmented 3D models support rehearsal, trajectory planning, and risk assessment around critical structures.

AR navigation outcomes Wearable AR navigation (e.g., FDA-cleared xvision) has shown high pedicle-screw placement accuracy (reported ~96.7% thoracic and ~99.1% lumbosacral) and may reduce operative time and radiation exposure.

Patient-specific surgery Segmentation + 3D printing/predictive modeling enable personalized approaches and implants (e.g., patient-specific rods, templates, custom cages), with early reports of high accuracy for template-guided instrumentation and promising feasibility for custom interbody devices.

Endoscopic techniques ESS supports minimally invasive treatment across multiple pathologies and can match conventional outcomes for lumbar disc herniation while improving recovery (e.g., shorter stays/earlier return to work), but broader adoption is constrained by learning curve and reimbursement challenges.

Implementation ethics/costs High acquisition/maintenance costs and limited reimbursement risk widening access disparities; recommended mitigations include subsidized training, shared equipment models, and reimbursement policies to support equitable implementation alongside standardized outcomes and training.

External Ventricular Drain Placement Using Active Augmented Reality Guidance

Operative Neurosurgery 30:414–421, 2026

This technical note presents a proof-of-concept augmented reality (AR) system that guides external ventricular drain (EVD) placement by integrating cloud-based automatic CT segmentation, PACS compatibility, trajectory planning, point-based image-to-patient registration, and real-time 3D AR guidance via an AR head-mounted display. The low-cost, end-to-end workflow and universal tracking tools aim to reduce attention shifts and improve accessibility compared with conventional neuronavigation.

The system was tested in a phantom study with 29 AR-guided EVD insertions by neurosurgical clinicians, yielding 69% optimal placements (Kakarla grade 1), a mean distance-to-target of 9.49 mm, mean angular deviation of 9.20°, an FRE of 4.00 mm, and mean procedural time of 22:45. Authors identify human–computer interaction, tracking fidelity, registration accuracy, and procedural time as primary areas for refinement before clinical adoption.

Augmented Reality (AR) Guidance: A low-cost, end-to-end AR system was developed for external ventricular drain (EVD) placement, integrating real-time 3D guidance, automated CT segmentation, and compatibility with standard hospital PACS infrastructure, all visualized through AR head-mounted displays (AR-HMDs).

Workflow Components: The system includes cloud-based image storage, automatic segmentation, trajectory planning, point-based image-to-patient registration, and real-time EVD tracking, aiming to reduce attention shifts and improve procedural integration.

Proof-of-Concept Results: In simulated procedures on anatomical phantoms with small ventricles, 69% of placements were optimal (Kakarla 1), with a mean distance to target of 9.49 mm and mean angular deviation of 9.20°, but accuracy is not yet at the level of best clinical standards.

Procedural Time: The mean workflow duration was nearly 23 minutes, which is longer than acceptable for emergency EVD placements, with most of the added time attributed to trajectory planning, marker attachment, and image-to-patient registration.

Usability and Interface Challenges: Users experienced difficulties with human-computer interaction, including issues with holographic controls, visual clutter, and marker tracking, which impacted both speed and accuracy.

Affordability and Accessibility: The AR-HMD system (approx. $4950) is significantly less expensive than traditional neuronavigation systems, potentially increasing access to advanced guidance in resource-limited settings

High-Accuracy Augmented Reality Guidance for Intracranial Drain Placement Using a Standalone Head-Worn Navigation System

Neurosurgery 96:1217–1226, 2025

A standalone augmented reality (AR) headset navigation system was clinically validated for external ventricular drain (EVD) placement, demonstrating improved accuracy, higher first-attempt success, and reduced complications compared to freehand technique, supporting AR as a safe, effective, and ergonomic alternative for neurosurgical procedures.

• A standalone head-worn augmented reality (AR) navigation system was developed for external ventricular drain (EVD) placement.

• A prospective clinical pilot study compared AR-guided EVD placement to freehand technique in emergency/ICU settings.

• AR guidance achieved 100% functional first-attempt placements, significantly higher optimal placement rates, and lower complication and revision rates than freehand.

• Placement quality was evaluated with an extended modified Kakarla scale and all AR placements were functional on the first attempt.

• The AR system used high-accuracy inside-out infrared tracking and real-time 3D anatomical overlays for planning and guidance.

• Complications in the AR group were fewer and less severe, with errors attributed to hardware misuse rather than the AR guidance itself.

• Surgeons reported good acceptance and ease of use of the AR system, with minimal workflow disruption.

• A multicenter randomized controlled trial is planned to further validate these findings.

A Low-Cost Mobile-Based Augmented Reality Neuronavigation System for Retrosigmoid Craniotomy

Operative Neurosurgery 26:695–701, 2024

The correct positioning of the transverse-sigmoid sinus junction (TSSJ) during retrosigmoid craniotomy (RC) is crucial for enhancing surgical efficiency and preventing complications. An augmented reality technology may provide low-cost guidance for the TSSJ position. The authors aimed to investigate the clinical application of a self-developed mobile augmented reality navigation system (MARNS) for TSSJ positioning during RC and present their findings.

METHODS: This observational research enrolled patients who underwent RC at Fujian Provincial Hospital from May 2023 to June 2023. All patients had their TSSJs located by MARNS. The surgical incision and skull “keyhole” for drilling were determined separately based on the projections of TSSJ on the 3-dimensional model displayed by MARNS. This method was assessed using matching error, positioning time, integrity of the bone flap, incidence of transversal sigmoid sinus injury, and other complications.

RESULTS: Seven patients diagnosed with acoustic neuroma, trigeminal neuralgia, and hemifacial spasm were enrolled in this study. The MARNS system exhibited a matching error with an average magnitude of 2.88 ± 0.69 mm. The positioning procedure necessitated an average duration of 279.71 ± 27.29 seconds. In every instance, the inner edge of the TSSJ was precisely identified and exposed while the bone flap was successfully formed and maintained an average integrity of 86.7%.

CONCLUSION: This study demonstrated the efficacy of MARNS in the precise placement of the TSSJ during RC procedures. It offers advantages for convenience, cost-effectiveness, and reliability for neurosurgical navigation.

Mixed Reality for Cranial Neurosurgical Planning

Operative Neurosurgery 26:551–558, 2024

Mixed reality (MxR) benefits neurosurgery by improving anatomic visualization, surgical planning and training. We aim to validate the usability of a dedicated certified system for this purpose.

METHODS: All cases prepared with MxR in our center in 2022 were prospectively collected. Holographic rendering was achieved using an incorporated fully automatic algorithm in the MxR application, combined with contrast-based semiautomatic rendering and/or manual segmentation where necessary. Hologram segmentation times were documented. Visualization during surgical preparation (defined as the interval between finalized anesthesiological induction and sterile draping) was performed using MxR glasses and direct streaming to a side screen. Surgical preparation times were compared with a matched historical cohort of 2021. Modifications of the surgical approach after 3-dimensional (3D) visualization were noted. Usability was assessed by evaluating 7 neurosurgeons with more than 3 months of experience with the system using a Usefulness, Satisfaction and Ease of use (USE) questionnaire.

RESULTS: One hundred-seven neurosurgical cases prepared with a 3D hologram were collected. Surgical indications were oncologic (63/107, 59%), cerebrovascular (27/107, 25%), and carotid endarterectomy (17/107, 16%). Mean hologram segmentation time was 39.4 ± 20.4 minutes. Average surgical preparation time was 48.0 ± 17.3 minutes for MxR cases vs 52 ± 17 minutes in the matched 2021 cohort without MxR (mean difference 4, 95% CI 1.7527-9.7527). Based on the 3D hologram, the surgical approach was modified in 3 cases. Good usability was found by 57% of the users.

CONCLUSION: The perioperative use of 3D holograms improved direct anatomic visualization while not significantly increasing intraoperative surgical preparation time. Usability of the system was adequate. Further technological development is necessary to improve the automatic algorithms and reduce the preparation time by circumventing manual and semiautomatic segmentation. Future studies should focus on quantifying the potential benefits in teaching, training, and the impact on surgical and functional outcomes.

Augmented Reality in Minimally Invasive Spinal Surgery

World Neurosurg. (2023) 176:35-42

Spine surgery has undergone significant changes in approach and technique. With the adoption of intraoperative navigation, minimally invasive spinal surgery (MISS) has arguably become the gold standard. Augmented reality (AR) has now emerged as a front-runner in anatomical visualization and narrower operative corridors. In effect, AR is poised to revolutionize surgical training and operative outcomes. Our study examines the current literature on AR-assisted MISS, synthesizes findings, and creates a narrative highlighting the history and future of AR in spine surgery.

MATERIAL AND METHODS: Relevant literature was gathered using the PubMed (Medline) database from 1975 to 2023. Pedicle screw placement models were the primary intervention in AR. These were compared to the outcomes of traditional MISS

RESULTS: We found that AR devices on the market show promising clinical outcomes in preoperative training and intraoperative use. Three prominent systems were as follows: XVision, HoloLens, and ImmersiveTouch. In the studies, surgeons, residents, and medical students had opportunities to operate AR systems, showcasing their educational potential across each phase of learning. Specifically, one facet described training with cadaver models to gauge accuracy in pedicle screw placement. AR-MISS exceeded free-hand methods without unique complications or contraindications.

CONCLUSIONS: While still in its infancy, AR has already proven beneficial for educational training and intraoperative MISS applications. We believe that with continued research and advancement of this technology, AR is poised to become a dominant player within the fundamentals of surgical education and MISS operative technique.

Augmented Reality–Assisted Percutaneous Rhizotomy for Trigeminal Neuralgia

Operative Neurosurgery 24:665–669, 2023

Percutaneous rhizotomy of the trigeminal nerve is a common surgery to manage medically refractory trigeminal neuralgia. Traditionally, these procedures have been performed based on anatomic landmarks with fluoroscopic guidance. Augmented reality (AR) relays virtual content on the real world and has the potential to improve localization of surgical targets based on preoperative imaging.

OBJECTIVE: To study the potential application and benefits of AR as an adjunct to traditional fluoroscopy-guided glycerol rhizotomy (GR).

METHODS: We used traditional fluoroscopy-guided percutaneous GR technique as previously described, performed under general anesthesia. Anatomic registration to the Medivis SurgicalAR system was performed based on the patient’s preoperative computerized tomography, and the surgeon was equipped with the system’s AR goggles. AR was used as an adjunct to fluoroscopy for trajectory planning to place a spinal needle into the medial aspect of the foramen ovale.

RESULTS: A 50-year-old woman with multiple sclerosis–related right-sided classical trigeminal neuralgia had persistent pain, refractory to medications, previous gamma knife stereotactic radiosurgery, and percutaneous radiofrequency rhizotomy performed elsewhere. The patient underwent AR-assisted fluoroscopy-guided percutaneous GR. The needle was placed into the right trigeminal cistern within seconds. She was discharged home after a few hours of observation with no complications and reported pain relief.

CONCLUSION: AR-assisted percutaneous rhizotomy may enhance the learning curve of these types of procedures and decrease surgery duration and radiation exposure. This allowed rapid and correct placement of a spinal needle through the foramen ovale.

Three-Dimensional Modeling and Augmented Reality and Virtual Reality Simulation of Fiber Dissection of the Cerebellum and Brainstem

Surgeons must understand the complex anatomy of the cerebellum and brainstem and their 3-dimensional (3D) relationships with each other for surgery to be successful. To the best of our knowledge, there have been no fiber dissection studies combined with 3D models, augmented reality (AR), and virtual reality (VR) of the structure of the cerebellum and brainstem. In this study, we created freely accessible AR and VR simulations and 3D models of the cerebellum and brainstem.

OBJECTIVE: To create 3D models and AR and VR simulations of cadaveric dissections of the human cerebellum and brainstem and to examine the 3D relationships of these structures.

METHODS: Ten cadaveric cerebellum and brainstem specimens were prepared in accordance with the Klingler’s method. The cerebellum and brainstem were dissected under the operating microscope, and 2-dimensional and 3D images were captured at every stage. With a photogrammetry tool (Qlone, EyeCue Vision Technologies, Ltd.), AR and VR simulations and 3D models were created by combining several 2-dimensional pictures.

RESULTS: For the first time reported in the literature, high-resolution, easily accessible, free 3D models and AR and VR simulations of cerebellum and brainstem dissections were created.

CONCLUSION: Fiber dissection of the cerebellum-brainstem complex and 3D models with AR and VR simulations are a useful addition to the goal of training neurosurgeons worldwide.

Robot-assisted and augmented reality–assisted spinal instrumentation

J Neurosurg Spine 37:299–314, 2022

The use of technology-enhanced methods in spine surgery has increased immensely over the past decade. Here, the authors present the largest systematic review and meta-analysis to date that specifically addresses patient-centered outcomes, including the risk of inaccurate screw placement and perioperative outcomes in spinal surgeries using robotic instrumentation and/or augmented reality surgical navigation (ARSN).

METHODS A systematic review of the literature in the PubMed, EMBASE, Web of Science, and Cochrane Library databases spanning the last decade (January 2011–November 2021) was performed to present all clinical studies comparing robot-assisted instrumentation and ARSN with conventional instrumentation techniques in lumbar spine surgery. The authors compared these two technologies as they relate to screw accuracy, estimated blood loss (EBL), intraoperative time, length of stay (LOS), perioperative complications, radiation dose and time, and the rate of reoperation.

RESULTS A total of 64 studies were analyzed that included 11,113 patients receiving 20,547 screws. Robot-assisted instrumentation was associated with less risk of inaccurate screw placement (p < 0.0001) regardless of control arm approach (freehand, fluoroscopy guided, or navigation guided), fewer reoperations (p < 0.0001), fewer perioperative complications (p < 0.0001), lower EBL (p = 0.0005), decreased LOS (p < 0.0001), and increased intraoperative time (p = 0.0003). ARSN was associated with decreased radiation exposure compared with robotic instrumentation (p = 0.0091) and fluoroscopy-guided (p < 0.0001) techniques.

CONCLUSIONS Altogether, the pooled data suggest that technology-enhanced thoracolumbar instrumentation is advantageous for both patients and surgeons. As the technology progresses and indications expand, it remains essential to continue investigations of both robotic instrumentation and ARSN to validate meaningful benefit over conventional instrumentation techniques in spine surgery.

Systematic review registration no.: CRD42021283631 (https://www.crd.york.ac.uk/prospero/)

Current status of augmented reality in cerebrovascular surgery: a systematic review

Neurosurgical Review (2022) 45:1951–1964

Augmented reality (AR) is an adjuvant tool in neuronavigation to improve spatial and anatomic understanding. The present review aims to describe the current status of intraoperative AR for the treatment of cerebrovascular pathology.

A systematic review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The following databases were searched: PubMed, Science Direct, Web of Science, and EMBASE up to December, 2020. The search strategy consisted of “augmented reality,” “AR,” “cerebrovascular,” “navigation,” “neurovascular,” “neurosurgery,” and “endovascular” in both AND and OR combinations. Studies included were original research articles with intraoperative application. The manuscripts were thoroughly examined for study design, outcomes, and results.

Sixteen studies were identified describing the use of intraoperative AR in the treatment of cerebrovascular pathology. A total of 172 patients were treated for 190 cerebrovascular lesions using intraoperative AR. The most common treated pathology was intracranial aneurysms. Most studies were cases and there was only a case–control study. A head-up display system in the microscope was the most common AR display. AR was found to be useful for tailoring the craniotomy, dura opening, and proper identification of donor and recipient vessels in vascular bypass. Most AR systems were unable to account for tissue deformation.

This systematic review suggests that intraoperative AR is becoming a promising and feasible adjunct in the treatment of cerebrovascular pathology. It has been found to be a useful tool in the preoperative planning and intraoperative guidance. However, its clinical benefits remain to be seen.

Real‐time augmented reality application in presurgical planning and lesion scalp localization by a smartphone

Acta Neurochirurgica (2022) 164:1069–1078

Objective A smartphone augmented reality (AR) application (app) was explored for clinical use in presurgical planning and lesion scalp localization.

Methods We programmed an AR App on a smartphone. The accuracy of the AR app was tested on a 3D-printed head model, using the Euclidean distance of displacement of virtual objects. For clinical validation, 14 patients with brain tumors were included in the study. Preoperative MRI images were used to generate 3D models for AR contents. The 3D models were then transferred to the smartphone AR app. Tumor scalp localization was marked, and a surgical corridor was planned on the patient’s head by viewing AR images on the smartphone screen. Standard neuronavigation was applied to evaluate the accuracy of the smartphone. Max-margin distance (MMD) and area overlap ratio (AOR) were measured to quantitatively validate the clinical accuracy of the smartphone AR technique.

Results In model validation, the total mean Euclidean distance of virtual object displacement using the smartphone AR app was 4.7 ± 2.3 mm. In clinical validation, the mean duration of AR app usage was 168.5 ± 73.9 s. The total mean MMD was 6.7 ± 3.7 mm, and total mean AOR was 79%.

Conclusions The smartphone AR app provides a new way of experience to observe intracranial anatomy in situ, and it makes surgical planning more intuitive and efficient. Localization accuracy is satisfactory with lesions larger than 15 mm.

Clinical accuracy and initial experience with augmented reality–assisted pedicle screw placement

J Neurosurg Spine 36:351–357, 2022

Augmented reality (AR) is a novel technology which, when applied to spine surgery, offers the potential for efficient, safe, and accurate placement of spinal instrumentation. The authors report the accuracy of the first 205 pedicle screws consecutively placed at their institution by using AR assistance with a unique head-mounted display (HMD) navigation system.

METHODS A retrospective review was performed of the first 28 consecutive patients who underwent AR-assisted pedicle screw placement in the thoracic, lumbar, and/or sacral spine at the authors’ institution. Clinical accuracy for each pedicle screw was graded using the Gertzbein-Robbins scale by an independent neuroradiologist working in a blinded fashion.

RESULTS Twenty-eight consecutive patients underwent thoracic, lumbar, or sacral pedicle screw placement with AR assistance. The median age at the time of surgery was 62.5 (IQR 13.8) years and the median body mass index was 31 (IQR 8.6) kg/m2. Indications for surgery included degenerative disease (n = 12, 43%); deformity correction (n = 12, 43%); tumor (n = 3, 11%); and trauma (n = 1, 4%). The majority of patients (n = 26, 93%) presented with low-back pain, 19 (68%) patients presented with radicular leg pain, and 10 (36%) patients had documented lower extremity weakness. A total of 205 screws were consecutively placed, with 112 (55%) placed in the lumbar spine, 67 (33%) in the thoracic spine, and 26 (13%) at S1. Screw placement accuracy was 98.5% for thoracic screws, 97.8% for lumbar/S1 screws, and 98.0% overall.

CONCLUSIONS AR depicted through a unique HMD is a novel and clinically accurate technology for the navigated insertion of pedicle screws. The authors describe the first 205 AR-assisted thoracic, lumbar, and sacral pedicle screws consecutively placed at their institution with an accuracy of 98.0% as determined by a Gertzbein-Robbins grade of A or B.

Augmented reality visualization in brain lesions: a prospective randomized controlled evaluation of its potential and current limitations in navigated microneurosurgery

Acta Neurochirurgica (2022) 26:3–14

Augmented reality (AR) has the potential to support complex neurosurgical interventions by including visual information seamlessly. This study examines intraoperative visualization parameters and clinical impact of AR in brain tumor surgery.

Methods Fifty-five intracranial lesions, operated either with AR-navigated microscope (n = 39) or conventional neuronavigation (n = 16) after randomization, have been included prospectively. Surgical resection time, duration/type/mode of AR, displayed objects (n, type), pointer-based navigation checks (n), usability of control, quality indicators, and overall surgical usefulness of AR have been assessed.

Results AR display has been used in 44.4% of resection time. Predominant AR type was navigation view (75.7%), followed by target volumes (20.1%). Predominant AR mode was picture-in-picture (PiP) (72.5%), followed by 23.3% overlay display. In 43.6% of cases, vision of important anatomical structures has been partially or entirely blocked by AR information. A total of 7.7% of cases used MRI navigation only, 30.8% used one, 23.1% used two, and 38.5% used three or more object segmentations in AR navigation. A total of 66.7% of surgeons found AR visualization helpful in the individual surgical case. AR depth information and accuracy have been rated acceptable (median 3.0 vs. median 5.0 in conventional neuronavigation). The mean utilization of the navigation pointer was 2.6   /resection hour (AR) vs. 9.7   /resection hour (neuronavigation); navigation effort was significantly reduced in AR (P < 0.001).

Conclusions The main benefit of HUD-based AR visualization in brain tumor surgery is the integrated continuous display allowing for pointer-less navigation. Navigation view (PiP) provides the highest usability while blocking the operative field less frequently. Visualization quality will benefit from improvements in registration accuracy and depth impression.

German clinical trials registration number. DRKS00016955.

The effect of augmented reality on the accuracy and learning curve of external ventricular drain placement

Neurosurg Focus 51 (2):E8, 2021

The traditional freehand technique for external ventricular drain (EVD) placement is most frequently used, but remains the primary risk factor for inaccurate drain placement. As this procedure could benefit from image guidance, the authors set forth to demonstrate the impact of augmented-reality (AR) assistance on the accuracy and learning curve of EVD placement compared with the freehand technique.

METHODS Sixteen medical students performed a total of 128 EVD placements on a custom-made phantom head, both before and after receiving a standardized training session. They were guided by either the freehand technique or by AR, which provided an anatomical overlay and tailored guidance for EVD placement through inside-out infrared tracking. The outcome was quantified by the metric accuracy of EVD placement as well as by its clinical quality.

RESULTS The mean target error was significantly impacted by either AR (p = 0.003) or training (p = 0.02) in a direct comparison with the untrained freehand performance. Both untrained (11.9 ± 4.5 mm) and trained (12.2 ± 4.7 mm) AR performances were significantly better than the untrained freehand performance (19.9 ± 4.2 mm), which improved after training (13.5 ± 4.7 mm). The quality of EVD placement as assessed by the modified Kakarla scale (mKS) was significantly impacted by AR guidance (p = 0.005) but not by training (p = 0.07). Both untrained and trained AR performances (59.4% mKS grade 1 for both) were significantly better than the untrained freehand performance (25.0% mKS grade 1). Spatial aptitude testing revealed a correlation between perceptual ability and untrained AR-guided performance (r = 0.63).

CONCLUSIONS Compared with the freehand technique, AR guidance for EVD placement yielded a higher outcome accuracy and quality for procedure novices. With AR, untrained individuals performed as well as trained individuals, which indicates that AR guidance not only improved performance but also positively impacted the learning curve. Future efforts will focus on the translation and evaluation of AR for EVD placement in the clinical setting.

Augmented reality–mediated stereotactic navigation for execution of en bloc lumbar spondylectomy osteotomies

J Neurosurg Spine 34:700–705, 2021

En bloc spinal tumor resections are technically demanding procedures with high morbidity because of the conventionally large exposure area and aggressive resection goals. Stereotactic surgical navigation presents an opportunity to perform the smallest possible resection plan while still achieving an en bloc resection.

Augmented reality (AR)–mediated spine surgery (ARMSS) via a mounted display with an integrated tracking camera is a novel FDA-approved technology for intraoperative “heads up” neuronavigation, with the proposed advantages of increased precision, workflow efficiency, and cost-effectiveness. As surgical experience and capability with this technology grow, the potential for more technically demanding surgical applications arises.

Here, the authors describe the use of ARMSS for guidance in a unique osteotomy execution to achieve an en bloc wide marginal resection of an L1 chordoma through a posterior-only approach while avoiding a tumor capsule breach. A technique is described to simultaneously visualize the navigational guidance provided by the contralateral surgeon’s tracked pointer and the progress of the BoneScalpel aligned in parallel with the tracked instrument, providing maximum precision and safety. The procedure was completed by reconstruction performed with a quad-rod and cabled fibular strut allograft construct, and the patient did well postoperatively.

Finally, the authors review the technical aspects of the approach, as well as the applications and limitations of this new technology.

Augmented reality–assisted pedicle screw insertion

J Neurosurg Spine 31:139–146, 2019

Augmented reality (AR) is a novel technology that has the potential to increase the technical feasibility, accuracy, and safety of conventional manual and robotic computer-navigated pedicle insertion methods. Visual data are directly projected to the operator’s retina and overlaid onto the surgical field, thereby removing the requirement to shift attention to a remote display. The objective of this study was to assess the comparative accuracy of AR-assisted pedicle screw insertion in comparison to conventional pedicle screw insertion methods.

METHODS Five cadaveric male torsos were instrumented bilaterally from T6 to L5 for a total of 120 inserted pedicle screws. Postprocedural CT scans were obtained, and screw insertion accuracy was graded by 2 independent neuroradiologists using both the Gertzbein scale (GS) and a combination of that scale and the Heary classification, referred to in this paper as the Heary-Gertzbein scale (HGS). Non-inferiority analysis was performed, comparing the accuracy to freehand, manual computer-navigated, and robotics-assisted computer-navigated insertion accuracy rates reported in the literature. User experience analysis was conducted via a user experience questionnaire filled out by operators after the procedures.

RESULTS The overall screw placement accuracy achieved with the AR system was 96.7% based on the HGS and 94.6% based on the GS. Insertion accuracy was non-inferior to accuracy reported for manual computer-navigated pedicle insertion based on both the GS and the HGS scores. When compared to accuracy reported for robotics-assisted computer-navigated insertion, accuracy achieved with the AR system was found to be non-inferior when assessed with the GS, but superior when assessed with the HGS. Last, accuracy results achieved with the AR system were found to be superior to results obtained with freehand insertion based on both the HGS and the GS scores. Accuracy results were not found to be inferior in any comparison. User experience analysis yielded “excellent” usability classification.

CONCLUSIONS AR-assisted pedicle screw insertion is a technically feasible and accurate insertion method.

 

App-assisted external ventricular drain insertion

app-assisted-external-ventricular-drain-insertion

J Neurosurg 125:754–758, 2016

The freehand technique for insertion of an external ventricular drain (EVD) is based on fixed anatomical landmarks and does not take individual variations into consideration. A patient-tailored approach based on augmented-reality techniques using devices such as smartphones can address this shortcoming. The Sina neurosurgical assist (Sina) is an Android mobile device application (app) that was designed and developed to be used as a simple intraoperative neurosurgical planning aid. It overlaps the patient’s images from previously performed CT or MRI studies on the image seen through the device camera.

The device is held by an assistant who aligns the images and provides information about the relative position of the target and EVD to the surgeon who is performing EVD insertion. This app can be used to provide guidance and continuous monitoring during EVD placement.

The author describes the technique of Sina-assisted EVD insertion into the frontal horn of the lateral ventricle and reports on its clinical application in 5 cases as well as the results of ex vivo studies of ease of use and precision. The technique has potential for further development and use with other augmented-reality devices.

Comparative effectiveness and safety of image guidance systems in neurosurgery

AR

J Neurosurg 123:307–313, 2015

Over the last decade, image guidance systems have been widely adopted in neurosurgery. Nonetheless, the evidence supporting the use of these systems in surgery remains limited. The aim of this study was to compare simultaneously the effectiveness and safety of various image guidance systems against that of standard surgery.

Methods In this preclinical, randomized study, 50 novice surgeons were allocated to one of the following groups: 1) no image guidance, 2) triplanar display, 3) always-on solid overlay, 4) always-on wire mesh overlay, and 5) on-demand inverse realism overlay. Each participant was asked to identify a basilar tip aneurysm in a validated model head. The primary outcomes were time to task completion (in seconds) and tool path length (in mm). The secondary outcomes were recognition of an unexpected finding (i.e., a surgical clip) and subjective depth perception using a Likert scale.

Results The time to task completion and tool path length were significantly lower when using any form of image guidance compared with no image guidance (p < 0.001 and p = 0.003, respectively). The tool path distance was also lower in groups using augmented reality compared with triplanar display (p = 0.010). Always-on solid overlay resulted in the greatest inattentional blindness (20% recognition of unexpected finding). Wire mesh and on-demand overlays mitigated, but did not negate, inattentional blindness and were comparable to triplanar display (40% recognition of unexpected finding in all groups). Wire mesh and inverse realism overlays also resulted in better subjective depth perception than always-on solid overlay (p = 0.031 and p = 0.008, respectively).

Conclusions New augmented reality platforms may improve performance in less-experienced surgeons. However, all image display modalities, including existing triplanar displays, carry a risk of inattentional blindness.

Augmented reality in the surgery of cerebral arteriovenous malformations

Augmented reality in the surgery of cerebral arteriovenous malformations

Acta Neurochir (2014) 156:1769–1774

Augmented reality technology has been used for intraoperative image guidance through the overlay of virtual images, from preoperative imaging studies, onto the realworld surgical field. Although setups based on augmented reality have been used for various neurosurgical pathologies, very few cases have been reported for the surgery of arteriovenous malformations (AVM). We present our experience with AVM surgery using a system designed for image injection of virtual images into the operating microscope’s eyepiece, and discuss why augmented reality may be less appealing in this form of surgery.

Methods N=5 patients underwent AVM resection assisted by augmented reality. Virtual three-dimensional models of patients’ heads, skulls, AVM nidi, and feeder and drainage vessels were selectively segmented and injected into the microscope’s eyepiece for intraoperative image guidance, and their usefulness was assessed in each case.

Results Although the setup helped in performing tailored craniotomies, in guiding dissection and in localizing drainage veins, it did not provide the surgeon with useful information concerning feeder arteries, due to the complexity of AVM angioarchitecture.

Conclusion The difficulty in intraoperatively conveying useful information on feeder vessels may make augmented reality a less engaging tool in this form of surgery, and might explain its underrepresentation in the literature. Integrating an AVM’s hemodynamic characteristics into the augmented rendering could make it more suited to AVM surgery.