Challenges in surgical video annotation

Abstract

Annotation of surgical video is important for establishing ground truth in surgical data science endeavors that involve computer vision. With the growth of the field over the last decade, several challenges have been identified in annotating spatial, temporal, and clinical elements of surgical video as well as challenges in selecting annotators. In reviewing current challenges, we provide suggestions on opportunities for improvement and possible next steps to enable translation of surgical data science efforts in surgical video analysis to clinical research and practice.

Keywords

• surgical video
• annotation
• image classification
• object detection
• semantic segmentation
• temporal annotation
• inter-rater reliability