Evaluating quasi-experimental approaches for estimating epidemiological efficacy of non-randomised field trials: applications in Wolbachia interventions for dengue

Background: Wolbachia symbiosis in Aedes aegypti is an emerging biocontrol measure against dengue. However, assessing its real-world efficacy is challenging due to the non-randomised, field-based nature of most intervention studies. This research re-evaluates the spatial–temporal impact of Wolbachia...

Full description

Saved in:
Bibliographic Details
Main Authors: Chow, Jo Yi, Geng, Lin, Bansal, Somya, Dickens, Borame Sue Lee, Ng, Lee Ching, Hoffmann, Ary Anthony, Lim, Jue Tao
Other Authors: Lee Kong Chian School of Medicine (LKCMedicine)
Format: Article
Language:English
Published: 2024
Subjects:
Online Access:https://hdl.handle.net/10356/181312
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-181312
record_format dspace
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Medicine, Health and Life Sciences
Wolbachia
Dengue
spellingShingle Medicine, Health and Life Sciences
Wolbachia
Dengue
Chow, Jo Yi
Geng, Lin
Bansal, Somya
Dickens, Borame Sue Lee
Ng, Lee Ching
Hoffmann, Ary Anthony
Lim, Jue Tao
Evaluating quasi-experimental approaches for estimating epidemiological efficacy of non-randomised field trials: applications in Wolbachia interventions for dengue
description Background: Wolbachia symbiosis in Aedes aegypti is an emerging biocontrol measure against dengue. However, assessing its real-world efficacy is challenging due to the non-randomised, field-based nature of most intervention studies. This research re-evaluates the spatial–temporal impact of Wolbachia interventions on dengue incidence using a large battery of quasi-experimental methods and assesses each method’s validity. Methods: A systematic search for Wolbachia intervention data was conducted via PUBMED. Efficacy was reassessed using commonly-used quasi-experimental approaches with extensive robustness checks, including geospatial placebo tests and a simulation study. Intervention efficacies across multiple study sites were computed using high-resolution aggregations to examine heterogeneities across sites and study periods. We further designed a stochastic simulation framework to assess the methods’ ability to estimate intervention efficacies (IE). Results: Wolbachia interventions in Singapore, Malaysia, and Brazil significantly decreased dengue incidence, with reductions ranging from 48.17% to 69.19%. IEs varied with location and duration. Malaysia showed increasing efficacy over time, while Brazil exhibited initial success with subsequent decline, hinting at operational challenges. Singapore's strategy was highly effective despite partial saturation. Simulations identified Synthetic Control Methods (SCM) and its variant, count Synthetic Control Method (cSCM), as superior in precision, with the smallest percentage errors in efficacy estimation. These methods also demonstrated robustness in placebo tests. Conclusions: Wolbachia interventions exhibit consistent protective effects against dengue. SCM and cSCM provided the most precise and robust estimates of IEs, validated across simulated and real-world settings.
author2 Lee Kong Chian School of Medicine (LKCMedicine)
author_facet Lee Kong Chian School of Medicine (LKCMedicine)
Chow, Jo Yi
Geng, Lin
Bansal, Somya
Dickens, Borame Sue Lee
Ng, Lee Ching
Hoffmann, Ary Anthony
Lim, Jue Tao
format Article
author Chow, Jo Yi
Geng, Lin
Bansal, Somya
Dickens, Borame Sue Lee
Ng, Lee Ching
Hoffmann, Ary Anthony
Lim, Jue Tao
author_sort Chow, Jo Yi
title Evaluating quasi-experimental approaches for estimating epidemiological efficacy of non-randomised field trials: applications in Wolbachia interventions for dengue
title_short Evaluating quasi-experimental approaches for estimating epidemiological efficacy of non-randomised field trials: applications in Wolbachia interventions for dengue
title_full Evaluating quasi-experimental approaches for estimating epidemiological efficacy of non-randomised field trials: applications in Wolbachia interventions for dengue
title_fullStr Evaluating quasi-experimental approaches for estimating epidemiological efficacy of non-randomised field trials: applications in Wolbachia interventions for dengue
title_full_unstemmed Evaluating quasi-experimental approaches for estimating epidemiological efficacy of non-randomised field trials: applications in Wolbachia interventions for dengue
title_sort evaluating quasi-experimental approaches for estimating epidemiological efficacy of non-randomised field trials: applications in wolbachia interventions for dengue
publishDate 2024
url https://hdl.handle.net/10356/181312
_version_ 1816859001661423616
spelling sg-ntu-dr.10356-1813122024-11-25T04:54:58Z Evaluating quasi-experimental approaches for estimating epidemiological efficacy of non-randomised field trials: applications in Wolbachia interventions for dengue Chow, Jo Yi Geng, Lin Bansal, Somya Dickens, Borame Sue Lee Ng, Lee Ching Hoffmann, Ary Anthony Lim, Jue Tao Lee Kong Chian School of Medicine (LKCMedicine) Medicine, Health and Life Sciences Wolbachia Dengue Background: Wolbachia symbiosis in Aedes aegypti is an emerging biocontrol measure against dengue. However, assessing its real-world efficacy is challenging due to the non-randomised, field-based nature of most intervention studies. This research re-evaluates the spatial–temporal impact of Wolbachia interventions on dengue incidence using a large battery of quasi-experimental methods and assesses each method’s validity. Methods: A systematic search for Wolbachia intervention data was conducted via PUBMED. Efficacy was reassessed using commonly-used quasi-experimental approaches with extensive robustness checks, including geospatial placebo tests and a simulation study. Intervention efficacies across multiple study sites were computed using high-resolution aggregations to examine heterogeneities across sites and study periods. We further designed a stochastic simulation framework to assess the methods’ ability to estimate intervention efficacies (IE). Results: Wolbachia interventions in Singapore, Malaysia, and Brazil significantly decreased dengue incidence, with reductions ranging from 48.17% to 69.19%. IEs varied with location and duration. Malaysia showed increasing efficacy over time, while Brazil exhibited initial success with subsequent decline, hinting at operational challenges. Singapore's strategy was highly effective despite partial saturation. Simulations identified Synthetic Control Methods (SCM) and its variant, count Synthetic Control Method (cSCM), as superior in precision, with the smallest percentage errors in efficacy estimation. These methods also demonstrated robustness in placebo tests. Conclusions: Wolbachia interventions exhibit consistent protective effects against dengue. SCM and cSCM provided the most precise and robust estimates of IEs, validated across simulated and real-world settings. Ministry of Education (MOE) Nanyang Technological University National Research Foundation (NRF) Published version This research is hosted by CNRS@CREATE and supported by the National Research Foundation, Prime Minister’s Office, Singapore, under its Campus for Research Excellence and Technological Enterprise (CREATE) program, and is funded by the Lee Kong Chian School of Medicine—Ministry of Education Start-Up Grant. 2024-11-25T04:54:57Z 2024-11-25T04:54:57Z 2024 Journal Article Chow, J. Y., Geng, L., Bansal, S., Dickens, B. S. L., Ng, L. C., Hoffmann, A. A. & Lim, J. T. (2024). Evaluating quasi-experimental approaches for estimating epidemiological efficacy of non-randomised field trials: applications in Wolbachia interventions for dengue. BMC Medical Research Methodology, 24(1), 170-. https://dx.doi.org/10.1186/s12874-024-02291-6 1471-2288 https://hdl.handle.net/10356/181312 10.1186/s12874-024-02291-6 39107710 2-s2.0-85200487595 1 24 170 en CREATE NTU SUG MOE SUG BMC Medical Research Methodology © The Author(s) 2024, corrected publication 2024. Open Access. This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modifed the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/. application/pdf