Frontiers in Digital Health (Jul 2021)

Markup: A Web-Based Annotation Tool Powered by Active Learning

  • Samuel Dobbie,
  • Samuel Dobbie,
  • Huw Strafford,
  • Huw Strafford,
  • W. Owen Pickrell,
  • W. Owen Pickrell,
  • Beata Fonferko-Shadrach,
  • Carys Jones,
  • Ashley Akbari,
  • Ashley Akbari,
  • Simon Thompson,
  • Simon Thompson,
  • Arron Lacey,
  • Arron Lacey

DOI
https://doi.org/10.3389/fdgth.2021.598916
Journal volume & issue
Vol. 3

Abstract

Read online

Across various domains, such as health and social care, law, news, and social media, there are increasing quantities of unstructured texts being produced. These potential data sources often contain rich information that could be used for domain-specific and research purposes. However, the unstructured nature of free-text data poses a significant challenge for its utilisation due to the necessity of substantial manual intervention from domain-experts to label embedded information. Annotation tools can assist with this process by providing functionality that enables the accurate capture and transformation of unstructured texts into structured annotations, which can be used individually, or as part of larger Natural Language Processing (NLP) pipelines. We present Markup (https://www.getmarkup.com/) an open-source, web-based annotation tool that is undergoing continued development for use across all domains. Markup incorporates NLP and Active Learning (AL) technologies to enable rapid and accurate annotation using custom user configurations, predictive annotation suggestions, and automated mapping suggestions to both domain-specific ontologies, such as the Unified Medical Language System (UMLS), and custom, user-defined ontologies. We demonstrate a real-world use case of how Markup has been used in a healthcare setting to annotate structured information from unstructured clinic letters, where captured annotations were used to build and test NLP applications.

Keywords