Synthesizing speech test cases with text-to-speech? An empirical study on the false alarms in automated speech recognition testing

• Main Authors: LAU, Julia Kaiwen, KONG, Kelvin Kai Wen, YONG, Julian Hao, TAN, Per Hoong, YANG, Zhou, YONG, Zi Qian, LOW, Joshua Chern Wey, CHONG, Chun Yong, LIM, Mei Kuan, David LO
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Automated speech recognition; Empirical studies; False alarms; Number of false alarms; Software testings; Speech tests; Synthetic tests; Test case; Text to speech; Text-to-speech system; Databases and Information Systems; Software Engineering
• Online Access: https://ink.library.smu.edu.sg/sis_research/8566; https://ink.library.smu.edu.sg/context/sis_research/article/9569/viewcontent/Synthesizing_Speech_Test_Cases_with_Text_to_Speech__An_Empirical_Study_on_the_False_Alarms_in_Automated_Speech_Recognition_Testing.pdf
• Institution: Singapore Management University

Recent studies have proposed the use of Text-To-Speech (TTS) systems to automatically synthesise speech test cases on a scale and uncover a large number of failures in ASR systems. However, the failures uncovered by synthetic test cases may not reflect the actual performance of an ASR system when it...