J Neurosurg 131:25–31, 2019
Ruptured intracranial aneurysms (RIAs) can be managed surgically or endovascularly. In this study, the authors aimed to measure the interobserver agreement in selecting the best management option for various patients with an RIA.
METHODS The authors constructed an electronic portfolio of 42 cases of RIA in which an angiographic image along with a brief clinical vignette for each patient were displayed. Undisclosed to the responders was that the RIAs had been categorized as International Subarachnoid Aneurysm Trial (ISAT) (small, anterior-circulation, non–middle cerebral artery location, n = 18) and non-ISAT (n = 22) aneurysms; the non-ISAT group also included 2 basilar apex aneurysms for which a high number of endovascular choices was expected. The portfolio was sent to 132 clinicians who manage pa- tients with RIAs and circulated to members of an American surgical association. Judges were asked to choose between surgical and endovascular management, to indicate their level of confidence in the choice of treatment on a quantitative 0–10 scale, and to determine whether they would include the patient in a randomized trial in which both treatments are compared. Eleven clinicians were asked to respond twice at least 1 month apart. Responses were analyzed using kappa statistics.
RESULTS Eighty-five clinicians (58 cerebrovascular surgeons, 21 interventional neuroradiologists, and 6 interventional neurologists) answered the questionnaire. Overall, endovascular management was chosen more frequently (n = 2136 [59.8%] of 3570 answers). The proportions of decisions to clip were significantly higher for non-ISAT (50.8%) than for ISAT (26.2%) aneurysms (p = 0.0003). Interjudge agreement was only fair (kappa 0.210, 95% CI 0.158–0.276) for all cases and judges, despite high confidence levels (mean score > 8 for all cases). Agreement was no better within sub- groups of clinicians with the same specialty, years of experience, or location of practice or across capability groups (ability to clip or coil, or both). When agreement was defined as > 80% of responders choosing the same option, agreement occurred for only 7 of 40 cases, all of which were ISAT aneurysms, for which coiling was preferred.
CONCLUSIONS Agreement between clinicians regarding the best management option was infrequent but centered around coiling for some ISAT aneurysms. Surgical clipping was chosen more frequently for non-ISAT aneurysms than for ISAT aneurysms. Patients with such an aneurysm might be candidates for inclusion in randomized trials.