Benchmark dataset for clot detection in ischemic stroke vessel-based imaging: CODEC-IV

Abstract

We present an annotated dataset for the purposes of creating a benchmark in Artificial Intelligence for automated clot detection. While there are commercial tools available for automated clot detection on computed tomographic (CT) angiographs, they have not been compared in a standardized manner whereby accuracy is reported on a publicly available benchmark dataset. Furthermore, there are known difficulties in automated clot detection – namely, cases where there is robust collateral flow, or residual flow and occlusions of the smaller vessels – and it is necessary to drive an initiative to overcome these challenges. Our dataset contains 159 multiphase CTA patient datasets, derived from CTP and annotated by expert stroke neurologists. In addition to images where the clot is marked, the expert neurologists have provided information about clot location, hemisphere and the degree of collateral flow. The data is available on request by researchers via an online form, and we will host a leaderboard where the results of clot detection algorithms on the dataset will be displayed. Participants are invited to submit an algorithm to us for evaluation using the evaluation tool, which is made available at together with the form at https://github.com/MBC-Neuroimaging/ClotDetectEval.

Keywords

• Machine learning
• Clot detection
• Ischemic stroke
• Computed tomography