Combining Viral Genetics and Statistical Modeling to Improve HIV-1 Time-of-infection Estimation towards Enhanced Vaccine Efficacy Assessment
Raabya Rossenkhan,
Morgane Rolland,
Jan P.L. Labuschagne,
Roux-Cil Ferreira,
Craig A. Magaret,
Lindsay N. Carpp,
Frederick A. Matsen IV,
Yunda Huang,
Erika E. Rudnicki,
Yuanyuan Zhang,
Nonkululeko Ndabambi,
Murray Logan,
Ted Holzman,
Melissa-Rose Abrahams,
Colin Anthony,
Sodsai Tovanabutra,
Christopher Warth,
Gordon Botha,
David Matten,
Sorachai Nitayaphan,
Hannah Kibuuka,
Fred K. Sawe,
Denis Chopera,
Leigh Anne Eller,
Simon Travers,
Merlin L. Robb,
Carolyn Williamson,
Peter B. Gilbert,
Paul T. Edlefsen
Affiliations
Raabya Rossenkhan
Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA
Morgane Rolland
U.S. Military HIV Research Program, Walter Reed Army Institute of Research, Silver Spring, MD 20910, USA
Jan P.L. Labuschagne
Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA
Roux-Cil Ferreira
Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA
Craig A. Magaret
Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA
Lindsay N. Carpp
Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA
Frederick A. Matsen IV
Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA
Yunda Huang
Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA
Erika E. Rudnicki
Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA
Yuanyuan Zhang
Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA
Nonkululeko Ndabambi
Department of Pathology, Faculty of Health Sciences, Institute of Infectious Disease and Molecular Medicine, University of Cape Town, Cape Town 7925, South Africa
Murray Logan
Department of Pathology, Faculty of Health Sciences, Institute of Infectious Disease and Molecular Medicine, University of Cape Town, Cape Town 7925, South Africa
Ted Holzman
Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA
Melissa-Rose Abrahams
Department of Pathology, Faculty of Health Sciences, Institute of Infectious Disease and Molecular Medicine, University of Cape Town, Cape Town 7925, South Africa
Colin Anthony
Department of Pathology, Faculty of Health Sciences, Institute of Infectious Disease and Molecular Medicine, University of Cape Town, Cape Town 7925, South Africa
Sodsai Tovanabutra
U.S. Military HIV Research Program, Walter Reed Army Institute of Research, Silver Spring, MD 20910, USA
Christopher Warth
Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA
Gordon Botha
Department of Pathology, Faculty of Health Sciences, Institute of Infectious Disease and Molecular Medicine, University of Cape Town, Cape Town 7925, South Africa
David Matten
Department of Pathology, Faculty of Health Sciences, Institute of Infectious Disease and Molecular Medicine, University of Cape Town, Cape Town 7925, South Africa
Sorachai Nitayaphan
Armed Forces Research Institute of Medical Sciences, Bangkok 10400, Thailand
Hannah Kibuuka
Makerere University Walter Reed Project, Kampala, Uganda
Fred K. Sawe
Kenya Medical Research Institute/U.S. Army Medical Research Directorate-Africa/Kenya-Henry Jackson Foundation MRI, Kericho 20200, Kenya
Denis Chopera
Sub-Saharan African Network for TB/HIV Research Excellence (SANTHE), Africa Health Research Institute, Durban 4001, South Africa
Leigh Anne Eller
U.S. Military HIV Research Program, Walter Reed Army Institute of Research, Silver Spring, MD 20910, USA
Simon Travers
South African Medical Research Council Bioinformatics Unit, South African National Bioinformatics Institute, University of the Western Cape, Cape Town 7535, South Africa
Merlin L. Robb
U.S. Military HIV Research Program, Walter Reed Army Institute of Research, Silver Spring, MD 20910, USA
Carolyn Williamson
Department of Pathology, Faculty of Health Sciences, Institute of Infectious Disease and Molecular Medicine, University of Cape Town, Cape Town 7925, South Africa
Peter B. Gilbert
Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA
Paul T. Edlefsen
Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA
Knowledge of the time of HIV-1 infection and the multiplicity of viruses that establish HIV-1 infection is crucial for the in-depth analysis of clinical prevention efficacy trial outcomes. Better estimation methods would improve the ability to characterize immunological and genetic sequence correlates of efficacy within preventive efficacy trials of HIV-1 vaccines and monoclonal antibodies. We developed new methods for infection timing and multiplicity estimation using maximum likelihood estimators that shift and scale (calibrate) estimates by fitting true infection times and founder virus multiplicities to a linear regression model with independent variables defined by data on HIV-1 sequences, viral load, diagnostics, and sequence alignment statistics. Using Poisson models of measured mutation counts and phylogenetic trees, we analyzed longitudinal HIV-1 sequence data together with diagnostic and viral load data from the RV217 and CAPRISA 002 acute HIV-1 infection cohort studies. We used leave-one-out cross validation to evaluate the prediction error of these calibrated estimators versus that of existing estimators and found that both infection time and founder multiplicity can be estimated with improved accuracy and precision by calibration. Calibration considerably improved all estimators of time since HIV-1 infection, in terms of reducing bias to near zero and reducing root mean squared error (RMSE) to 5–10 days for sequences collected 1–2 months after infection. The calibration of multiplicity assessments yielded strong improvements with accurate predictions (ROC-AUC above 0.85) in all cases. These results have not yet been validated on external data, and the best-fitting models are likely to be less robust than simpler models to variation in sequencing conditions. For all evaluated models, these results demonstrate the value of calibration for improved estimation of founder multiplicity and of time since HIV-1 infection.