Abstract
Aim
The purpose of our study was to compare the agreement of both the total Alberta Stroke Program Early CT Score (ASPECTS) and region-based scores from two automated ASPECTS software packages and an expert consensus (EC) reading with final ASPECTS in a selected cohort of patients who had prompt reperfusion from endovascular thrombectomy (EVT).
Methods
ASPECTS were retrospectively and blindly assessed by two software packages and EC on baseline non-contrast-enhanced computed tomography (NCCT) images. All patients had multimodal CT imaging including NCCT, CT angiography, and CT perfusion which demonstrated an acute anterior circulation ischemic stroke with a large vessel occlusion. Final ASPECTS on follow-up scans in patients who had EVT and achieved complete reperfusion within 100 min from NCCT served as ground truth and were compared to total and region-based scores.
Results
Fifty-two patients met our study criteria. Moderate agreement was obtained between both software packages and EC for total ASPECTS and there was no significant difference in overall performance. However, the software packages differed with respect to regional contribution. In this cohort, the majority of infarcted regions were deep structures. Package A was more sensitive in cortical areas than the other methods, but at a cost of specificity. EC and software package B had greater sensitivity, but lower specificity for deep brain structures.
Conclusion
In this cohort, using the final ASPECTS as ground truth, no clinically significant difference was observed for total ASPECT score between human or automated packages, but there were differences in the characteristics of the regions scored.
Key Points
• Some national stroke guidelines have incorporated ASPECTS in their recommendations for selecting patients for endovascular therapy.
• Computer-aided diagnosis is a promising tool to aid the evaluation of early ischemic changes identified on CT.
• Software packages for automated ASPECTS assessment differed significantly with respect to regional contribution without any significant difference in the overall ASPECT score.
Similar content being viewed by others
Abbreviations
- ASPECTS:
-
Alberta Stroke Program Early CT Score
- C:
-
Caudate
- CTP:
-
CT perfusion
- EC:
-
Expert consensus
- EIC:
-
Early ischemic changes
- EVT:
-
Endovascular therapy
- HU:
-
Hounsfield units
- I:
-
Insula
- IC:
-
Internal capsule
- IQR:
-
Interquartile range
- L:
-
Lentiform nucleus
- NCCT:
-
Non-contrast computed tomography
- ROC:
-
Receiver operating characteristic
- TICI 3:
-
Thrombolysis in cerebral infarction with complete reperfusion
References
Barber PA, Demchuk AM, Zhang J, Buchan AM, Group AS (2000) Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. Lancet 355:1670–1674
Goyal M, Menon BK, Van Zwam WH et al (2016) Endovascular thrombectomy after large-vessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trials. Lancet 387:1723–1731
Powers WJ, Derdeyn CP, Biller J et al (2015) 2015 American Heart Association/American Stroke Association focused update of the 2013 guidelines for the early management of patients with acute ischemic stroke regarding endovascular treatment: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 46:3020–3035
Farzin B, Fahed R, Guilbert F et al (2016) Early CT changes in patients admitted for thrombectomy intrarater and interrater agreement. Neurology 87:249–256
Wilson AT, Dey S, Evans JW, Najm M, Qiu W, Menon BK (2018) Minds treating brains: understanding the interpretation of non-contrast CT ASPECTS in acute ischemic stroke. Expert Rev Cardiovasc Ther 16:143–153
Kottner J, Audigé L, Brorson S et al (2011) Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. Int J Nurs Stud 48:661–671
Bossuyt PM, Reitsma JB, Bruns DE et al (2003) The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Intern Med 138:W1–W12
Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420
Herweh C, Ringleb PA, Rauch G et al (2016) Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patients. Int J Stroke 11:438–445
Nagel S, Sinha D, Day D et al (2017) e-ASPECTS software is non-inferior to neuroradiologists in applying the ASPECT score to computed tomography scans of acute ischemic stroke patients. Int J Stroke 12:615–622
Gupta AC, Schaefer PW, Chaudhry ZA et al (2012) Interobserver reliability of baseline noncontrast CT Alberta Stroke Program Early CT Score for intra-arterial stroke treatment selection. AJNR Am J Neuroradiol 33:1046–1049
Pexman JH, Barber PA, Hill MD et al (2001) Use of the Alberta Stroke Program Early CT Score (ASPECTS) for assessing CT scans in patients with acute stroke. AJNR Am J Neuroradiol 22:1534–1542
Khan M, Baird GL, Goddeau RP Jr, Silver B, Henninger N (2017) Alberta Stroke Program Early CT Score infarct location predicts outcome following M2 occlusion. Front Neurol 8:98
Sheth SA, Malhotra K, Liebeskind DS et al (2018) Regional contributions to poststroke disability in endovascular therapy. Interv Neurol 7:533–543
van der Zwan A, Hillen B, Tulleken CA, Dujovny M, Dragovic L (1992) Variability of the territories of the major cerebral arteries. J Neurosurg 77:927–940
Seker F, Pfaff J, Nagel S et al (2018) CT reconstruction levels affect automated and reader-based ASPECTS ratings in acute ischemic stroke. J Neuroimaging. https://doi.org/10.1111/jon.12562
Pfaff J, Herweh C, Schieber S et al (2017) e-ASPECTS correlates with and is predictive of outcome after mechanical thrombectomy. AJNR Am J Neuroradiol 38:1594–1599
Funding
The authors state that this work has not received any funding.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Guarantor
The scientific guarantor of this publication is Olav Jansen.
Conflict of interest
The authors of this manuscript declare no relationships with any companies whose products or services may be related to the subject matter of the article.
Statistics and biometry
One of the authors has significant statistical expertise.
No complex statistical methods were necessary for this paper.
Informed consent
Written informed consent was waived by the Institutional Review Board.
Ethical approval
Institutional Review Board approval was obtained.
Methodology
• Retrospective
• Diagnostic study or prognostic study
• Performed at one institution
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Austein, F., Wodarg, F., Jürgensen, N. et al. Automated versus manual imaging assessment of early ischemic changes in acute stroke: comparison of two software packages and expert consensus. Eur Radiol 29, 6285–6292 (2019). https://doi.org/10.1007/s00330-019-06252-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00330-019-06252-2