Automated interpretation of systolic and diastolic function on the echocardiogram: a multicohort study

Background: Echocardiography is the diagnostic modality for assessing cardiac systolic and diastolic function to diagnose and manage heart failure. However, manual interpretation of echocardiograms can be time consuming and subject to human error. Therefore, we developed a fully automated deep learn...

Full description

Saved in:
Bibliographic Details
Main Authors: Tromp, Jasper, Seekings, Paul J., Hung, Chung-Lieh, Iversen, Mathias Bøtcher, Frost, Matthew James, Ouwerkerk, Wouter, Jiang, Zhubo, Eisenhaber, Frank, Goh, Rick S. M., Zhao, Heng, Huang, Weimin, Ling, Lieng-Hsi, Sim, David, Cozzone, Patrick, Richards, A. Mark, Lee, Hwee Kuan, Solomon, Scott D., Lam, Carolyn S. P., Ezekowitz, Justin A.
Other Authors: School of Biological Sciences
Format: Article
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/164204
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-164204
record_format dspace
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Science::Medicine
Diastolic Dysfunction
Echocardiography
spellingShingle Science::Medicine
Diastolic Dysfunction
Echocardiography
Tromp, Jasper
Seekings, Paul J.
Hung, Chung-Lieh
Iversen, Mathias Bøtcher
Frost, Matthew James
Ouwerkerk, Wouter
Jiang, Zhubo
Eisenhaber, Frank
Goh, Rick S. M.
Zhao, Heng
Huang, Weimin
Ling, Lieng-Hsi
Sim, David
Cozzone, Patrick
Richards, A. Mark
Lee, Hwee Kuan
Solomon, Scott D.
Lam, Carolyn S. P.
Ezekowitz, Justin A.
Automated interpretation of systolic and diastolic function on the echocardiogram: a multicohort study
description Background: Echocardiography is the diagnostic modality for assessing cardiac systolic and diastolic function to diagnose and manage heart failure. However, manual interpretation of echocardiograms can be time consuming and subject to human error. Therefore, we developed a fully automated deep learning workflow to classify, segment, and annotate two-dimensional (2D) videos and Doppler modalities in echocardiograms. Methods: We developed the workflow using a training dataset of 1145 echocardiograms and an internal test set of 406 echocardiograms from the prospective heart failure research platform (Asian Network for Translational Research and Cardiovascular Trials; ATTRaCT) in Asia, with previous manual tracings by expert sonographers. We validated the workflow against manual measurements in a curated dataset from Canada (Alberta Heart Failure Etiology and Analysis Research Team; HEART; n=1029 echocardiograms), a real-world dataset from Taiwan (n=31 241), the US-based EchoNet-Dynamic dataset (n=10 030), and in an independent prospective assessment of the Asian (ATTRaCT) and Canadian (Alberta HEART) datasets (n=142) with repeated independent measurements by two expert sonographers. Findings: In the ATTRaCT test set, the automated workflow classified 2D videos and Doppler modalities with accuracies (number of correct predictions divided by the total number of predictions) ranging from 0·91 to 0·99. Segmentations of the left ventricle and left atrium were accurate, with a mean Dice similarity coefficient greater than 93% for all. In the external datasets (n=1029 to 10 030 echocardiograms used as input), automated measurements showed good agreement with locally measured values, with a mean absolute error range of 9–25 mL for left ventricular volumes, 6–10% for left ventricular ejection fraction (LVEF), and 1·8–2·2 for the ratio of the mitral inflow E wave to the tissue Doppler e' wave (E/e' ratio); and reliably classified systolic dysfunction (LVEF <40%, area under the receiver operating characteristic curve [AUC] range 0·90–0·92) and diastolic dysfunction (E/e' ratio ≥13, AUC range 0·91–0·91), with narrow 95% CIs for AUC values. Independent prospective evaluation confirmed less variance of automated compared with human expert measurements, with all individual equivalence coefficients being less than 0 for all measurements. Interpretation: Deep learning algorithms can automatically annotate 2D videos and Doppler modalities with similar accuracy to manual measurements by expert sonographers. Use of an automated workflow might accelerate access, improve quality, and reduce costs in diagnosing and managing heart failure globally.
author2 School of Biological Sciences
author_facet School of Biological Sciences
Tromp, Jasper
Seekings, Paul J.
Hung, Chung-Lieh
Iversen, Mathias Bøtcher
Frost, Matthew James
Ouwerkerk, Wouter
Jiang, Zhubo
Eisenhaber, Frank
Goh, Rick S. M.
Zhao, Heng
Huang, Weimin
Ling, Lieng-Hsi
Sim, David
Cozzone, Patrick
Richards, A. Mark
Lee, Hwee Kuan
Solomon, Scott D.
Lam, Carolyn S. P.
Ezekowitz, Justin A.
format Article
author Tromp, Jasper
Seekings, Paul J.
Hung, Chung-Lieh
Iversen, Mathias Bøtcher
Frost, Matthew James
Ouwerkerk, Wouter
Jiang, Zhubo
Eisenhaber, Frank
Goh, Rick S. M.
Zhao, Heng
Huang, Weimin
Ling, Lieng-Hsi
Sim, David
Cozzone, Patrick
Richards, A. Mark
Lee, Hwee Kuan
Solomon, Scott D.
Lam, Carolyn S. P.
Ezekowitz, Justin A.
author_sort Tromp, Jasper
title Automated interpretation of systolic and diastolic function on the echocardiogram: a multicohort study
title_short Automated interpretation of systolic and diastolic function on the echocardiogram: a multicohort study
title_full Automated interpretation of systolic and diastolic function on the echocardiogram: a multicohort study
title_fullStr Automated interpretation of systolic and diastolic function on the echocardiogram: a multicohort study
title_full_unstemmed Automated interpretation of systolic and diastolic function on the echocardiogram: a multicohort study
title_sort automated interpretation of systolic and diastolic function on the echocardiogram: a multicohort study
publishDate 2023
url https://hdl.handle.net/10356/164204
_version_ 1759855978091642880
spelling sg-ntu-dr.10356-1642042023-02-28T17:12:39Z Automated interpretation of systolic and diastolic function on the echocardiogram: a multicohort study Tromp, Jasper Seekings, Paul J. Hung, Chung-Lieh Iversen, Mathias Bøtcher Frost, Matthew James Ouwerkerk, Wouter Jiang, Zhubo Eisenhaber, Frank Goh, Rick S. M. Zhao, Heng Huang, Weimin Ling, Lieng-Hsi Sim, David Cozzone, Patrick Richards, A. Mark Lee, Hwee Kuan Solomon, Scott D. Lam, Carolyn S. P. Ezekowitz, Justin A. School of Biological Sciences Bioinformatics Institute Genome Institute of Singapore Science::Medicine Diastolic Dysfunction Echocardiography Background: Echocardiography is the diagnostic modality for assessing cardiac systolic and diastolic function to diagnose and manage heart failure. However, manual interpretation of echocardiograms can be time consuming and subject to human error. Therefore, we developed a fully automated deep learning workflow to classify, segment, and annotate two-dimensional (2D) videos and Doppler modalities in echocardiograms. Methods: We developed the workflow using a training dataset of 1145 echocardiograms and an internal test set of 406 echocardiograms from the prospective heart failure research platform (Asian Network for Translational Research and Cardiovascular Trials; ATTRaCT) in Asia, with previous manual tracings by expert sonographers. We validated the workflow against manual measurements in a curated dataset from Canada (Alberta Heart Failure Etiology and Analysis Research Team; HEART; n=1029 echocardiograms), a real-world dataset from Taiwan (n=31 241), the US-based EchoNet-Dynamic dataset (n=10 030), and in an independent prospective assessment of the Asian (ATTRaCT) and Canadian (Alberta HEART) datasets (n=142) with repeated independent measurements by two expert sonographers. Findings: In the ATTRaCT test set, the automated workflow classified 2D videos and Doppler modalities with accuracies (number of correct predictions divided by the total number of predictions) ranging from 0·91 to 0·99. Segmentations of the left ventricle and left atrium were accurate, with a mean Dice similarity coefficient greater than 93% for all. In the external datasets (n=1029 to 10 030 echocardiograms used as input), automated measurements showed good agreement with locally measured values, with a mean absolute error range of 9–25 mL for left ventricular volumes, 6–10% for left ventricular ejection fraction (LVEF), and 1·8–2·2 for the ratio of the mitral inflow E wave to the tissue Doppler e' wave (E/e' ratio); and reliably classified systolic dysfunction (LVEF <40%, area under the receiver operating characteristic curve [AUC] range 0·90–0·92) and diastolic dysfunction (E/e' ratio ≥13, AUC range 0·91–0·91), with narrow 95% CIs for AUC values. Independent prospective evaluation confirmed less variance of automated compared with human expert measurements, with all individual equivalence coefficients being less than 0 for all measurements. Interpretation: Deep learning algorithms can automatically annotate 2D videos and Doppler modalities with similar accuracy to manual measurements by expert sonographers. Use of an automated workflow might accelerate access, improve quality, and reduce costs in diagnosing and managing heart failure globally. Agency for Science, Technology and Research (A*STAR) Published version The ATTRaCT programme was supported by research grants from the A*STAR Biomedical Research Council (grant numbers SPF2014/003, SPF2014/004, SPF2014/005) and A*STAR Exploit Technologies (grant number ETPL/17-GAP012-R20H). The Alberta Alberta HEART programme was supported by an Alberta Innovates–Health Solutions Interdisciplinary Team grant (grant number AHFMR ITG 200801018). 2023-01-09T07:03:13Z 2023-01-09T07:03:13Z 2022 Journal Article Tromp, J., Seekings, P. J., Hung, C., Iversen, M. B., Frost, M. J., Ouwerkerk, W., Jiang, Z., Eisenhaber, F., Goh, R. S. M., Zhao, H., Huang, W., Ling, L., Sim, D., Cozzone, P., Richards, A. M., Lee, H. K., Solomon, S. D., Lam, C. S. P. & Ezekowitz, J. A. (2022). Automated interpretation of systolic and diastolic function on the echocardiogram: a multicohort study. The Lancet Digital Health, 4(1), e46-e54. https://dx.doi.org/10.1016/S2589-7500(21)00235-1 2589-7500 https://hdl.handle.net/10356/164204 10.1016/S2589-7500(21)00235-1 4 2-s2.0-85121510603 1 4 e46 e54 en SPF2014/003 SPF2014/004 SPF2014/005 ETPL/17-GAP012-R20H The Lancet Digital Health © 2021 The Author(s). Published by Elsevier Ltd. This is an Open Access article under the CC BY-NC-ND 4.0 license. application/pdf