Methods for conducting international Delphi surveys to optimise global participation in core outcome set development: a case study in gastric cancer informed by a comprehensive literature review
Bilal Alkhaffaf,
Jane M. Blazeby,
Aleksandra Metryka,
Anne-Marie Glenny,
Ademola Adeyeye,
Paulo Matos Costa,
Ismael Diez del Val,
Suzanne S. Gisbertz,
Ali Guner,
Simon Law,
Hyuk-Joon Lee,
Ziyu Li,
Koji Nakada,
Rafael Mauricio Restrepo Nuñez,
Daniel Reim,
John V. Reynolds,
Peter Vorwald,
Daniela Zanotti,
William Allum,
M. Asif Chaudry,
Ewen Griffiths,
Paula R. Williamson,
Iain A. Bruce,
on behalf of the GASTROS International Working Group
Affiliations
Bilal Alkhaffaf
Department of Oesophago-Gastric Surgery, Salford Royal Hospital, Salford Royal NHS Foundation Trust
Jane M. Blazeby
Centre for Surgical Research and Bristol and Weston NIHR Biomedical Research Centre, University of Bristol
Aleksandra Metryka
Paediatric ENT Department, Royal Manchester Children’s Hospital, Manchester University NHS Foundation Trust
Anne-Marie Glenny
Division of Dentistry, School of Medical Sciences, Faculty of Biology, Medicine and Health, University of Manchester
Ademola Adeyeye
University of Ilorin Teaching Hospital
Paulo Matos Costa
Hospital Garcia de Orta, Faculdade de Medicina da Universidade de Lisboa
Ismael Diez del Val
Basurto University Hospital
Suzanne S. Gisbertz
Department of Surgery, Cancer Center, Amsterdam UMC, University of Amsterdam
Ali Guner
Department of General Surgery, Faculty of Medicine, Karadeniz Technical University
Simon Law
Department of Surgery, The University of Hong Kong
Hyuk-Joon Lee
Department of Surgery and Cancer Research Institute, Seoul National University College of Medicine
Ziyu Li
Peking University Cancer Hospital and Institute
Koji Nakada
Department of Laboratory Medicine, The Jikei University Daisan Hospital
Rafael Mauricio Restrepo Nuñez
Hospital Universitario Rey Juan Carlos
Daniel Reim
Department of Surgery, TUM School of Medicine
John V. Reynolds
Department of Surgery, Trinity Translational Medicine Institute and St James’s Hospital
Peter Vorwald
Hospital Universitario Fundación Jiménez Diaz
Daniela Zanotti
Regional Centre for Oesophago-gastric Surgery, Broomfield Hospital
William Allum
Department of Academic Surgery, Royal Marsden NHS Foundation Trust
M. Asif Chaudry
Department of Academic Surgery, Royal Marsden NHS Foundation Trust
Ewen Griffiths
Upper GI Unit, University Hospitals Birmingham NHS Foundation Trust, Queen Elizabeth Hospital Birmingham
Paula R. Williamson
MRC North West Hub for Trials Methodology Research, University of Liverpool and a member of Liverpool Health Partners
Iain A. Bruce
Division of Infection, Immunity and Respiratory Medicine, Faculty of Biology, Medicine and Health, University of Manchester
on behalf of the GASTROS International Working Group
Abstract Background Core outcome sets (COS) should be relevant to key stakeholders and widely applicable and usable. Ideally, they are developed for international use to allow optimal data synthesis from trials. Electronic Delphi surveys are commonly used to facilitate global participation; however, this has limitations. It is common for these surveys to be conducted in a single language potentially excluding those not fluent in that tongue. The aim of this study is to summarise current approaches for optimising international participation in Delphi studies and make recommendations for future practice. Methods A comprehensive literature review of current approaches to translating Delphi surveys for COS development was undertaken. A standardised methodology adapted from international guidance derived from 12 major sets of translation guidelines in the field of outcome reporting was developed. As a case study, this was applied to a COS project for surgical trials in gastric cancer to translate a Delphi survey into 7 target languages from regions active in gastric cancer research. Results Three hundred thirty-two abstracts were screened and four studies addressing COS development in rheumatoid and osteoarthritis, vascular malformations and polypharmacy were eligible for inclusion. There was wide variation in methodological approaches to translation, including the number of forward translations, the inclusion of back translation, the employment of cognitive debriefing and how discrepancies and disagreements were handled. Important considerations were identified during the development of the gastric cancer survey including establishing translation groups, timelines, understanding financial implications, strategies to maximise recruitment and regulatory approvals. The methodological approach to translating the Delphi surveys was easily reproducible by local collaborators and resulted in an additional 637 participants to the 315 recruited to complete the source language survey. Ninety-nine per cent of patients and 97% of healthcare professionals from non-English-speaking regions used translated surveys. Conclusion Consideration of the issues described will improve planning by other COS developers and can be used to widen international participation from both patients and healthcare professionals.