Operative Neurosurgery 30:760–764, 2026
This technical note reports three neurosurgical cases using the Medivis surgical augmented reality platform with the Microsoft HoloLens 2 to overlay real-time 3D imaging, exoscopic, and endoscopic outputs intraoperatively. The workflow, registration method, hardware and software integration, and case-specific operative details are described, with all patients recovering without complications.
The report evaluates benefits and limitations of wearable XR in the operating room, highlighting improved visualization, surgical precision, and ergonomics, while addressing challenges such as registration accuracy, latency, cognitive overload, and avenues for future hardware and software improvements.
Goal Integrate wearable XR/AR and spatial computing into neurosurgical operating rooms to enhance intraoperative visualization, precision, and ergonomics.
System setup Three neurosurgical cases used the Medivis SurgicalAR platform paired with a Microsoft HoloLens 2 worn by the primary surgeon, enabling overlay of 3D volumes and intraoperative video in the surgeon’s field of view.
Imaging workflow Preoperative CT/MRI (including tractography/connectomic imaging when available) were uploaded from PACS, processed quickly (windowing/coloring/cropping/brightening), and stored for OR use, then linked to the HoloLens.
Registration approach Intraoperative holographic point-matching registration matched physical landmarks on the patient to virtual fiducials via an optical localizer recognized by HoloLens 2, with an FDA-approved navigation system also used in all cases for confirmation.
Video integration Exoscopic/endoscopic outputs were captured and streamed to the AR computer and transmitted to the HoloLens for real-time manipulation and interaction by the surgeon.
Observed benefits Combined overlays improved visualization and supported ergonomic operating posture, optimized sight lines, and reduced OR footprint while maintaining standard team visualization via the exoscope monitor.
Case outcomes All three patients recovered well postoperatively without complications; no critical intraoperative issues from latency/dropped frames prevented procedure completion.
Limitations & next steps Key challenges include potential cognitive overload/inattentional blindness, hologram registration accuracy, and technical issues like latency/dropped frames; future work targets improved/universal registration and broader overlayable data streams (e.g., conferencing, checklists).




















You must be logged in to post a comment.