EmpathyEar : An open-source avatar multimodal empathetic chatbot

• Main Authors: FEI, Hao, ZHANG, Han, WANG, Bin, LIAO, Lizi, LIU, Qian, CAMBRIA, Erik
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2024
• Subjects: Multimodal chatbot; Empathetic response generation; Large language model; LLMs; Digital avatars; Artificial Intelligence and Robotics; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/9695; https://ink.library.smu.edu.sg/context/sis_research/article/10695/viewcontent/2024.acl_demos.7.pdf
• Institution: Singapore Management University

This paper introduces EmpathyEar, a pioneering open-source, avatar-based multimodal empathetic chatbot, to fill the gap in traditional text-only empathetic response generation (ERG) systems. Leveraging the advancements of a large language model, combined with multimodal encoders and generators, Empa...