A Shared Task for the Digital Humanities Chapter 3: Description of Submitted Guidelines and Final Evaluation Results

Abstract

In this chapter, we give a descriptive overview of the annotation guidelines, their use of narrative level concepts, and the results of their quantitative evaluation. We will also connect some of the results to qualitative findings we uncovered during the workshop, although some references to the participants’ objectives are conjecture. Finally, the chapter contains a reflection on the annotation and evaluation procedure.