Genome Biology (Oct 2023)

Genomic variant benchmark: if you cannot measure it, you cannot improve it

  • Sina Majidian,
  • Daniel Paiva Agustinho,
  • Chen-Shan Chin,
  • Fritz J. Sedlazeck,
  • Medhat Mahmoud

DOI
https://doi.org/10.1186/s13059-023-03061-1
Journal volume & issue
Vol. 24, no. 1
pp. 1 – 25

Abstract

Read online

Abstract Genomic benchmark datasets are essential to driving the field of genomics and bioinformatics. They provide a snapshot of the performances of sequencing technologies and analytical methods and highlight future challenges. However, they depend on sequencing technology, reference genome, and available benchmarking methods. Thus, creating a genomic benchmark dataset is laborious and highly challenging, often involving multiple sequencing technologies, different variant calling tools, and laborious manual curation. In this review, we discuss the available benchmark datasets and their utility. Additionally, we focus on the most recent benchmark of genes with medical relevance and challenging genomic complexity.

Keywords