会话分析研究 ：情感表述中的多模态表现 = Conversation analysis : multimodality in emotion display

• Main Author: 陈洁莹 Tan, Jacqueline Jie Ying
• Other Authors: Lim, Ni Eng
• Format: Final Year Project
• Language: Chinese
• Published: 2017
• Subjects: DRNTU::Humanities
• Online Access: http://hdl.handle.net/10356/72713
• Institution: Nanyang Technological University

生活当中有很多事情都必须通过交谈实现的。换言之，互动会话是完成我们生活中很多必须完成事情的方式。例如：人们也可以通过会话交流来传达及增进彼此之间的关系，甚至通过会话得到一些安慰。实际上我们很多时候在传达某种信息，不只是通过话语本身，也通过话语以外的，也就是我们所称的多模态，而多模态的运用也是很重要的。在这篇论文笔者会更具体的看情绪的表达，而情绪的表达是否更是需要结合话语以及话语以外的表现方式才能够成功地传达情绪。研究结果显示在传达情绪的过程中，会话不但不是最重要的工具，而且会话必须结合会话以外的模态才能成功地传达情绪。例如：话语结合音韵、脸部表情、体态和手势等。换言之，自然会话及情绪表达普遍上是多模态的。Communication is vital in our day-to-day life and people need to communicate to achieve things. For instance, to improve relationships and to receive consolation from others. However, while conveying message, we do not often solely use utterance. Instead, we also use other modalities to deliver the message. In other words, interactive conversation is multimodality and multimodality are important. This study examines emotion display and whether emotion display requires both utterance and other modalities to convey the message successfully. The results show that utterance is not just unimportant, it is also necessary to work with other modalities to convey the message successfully. In other words, emotion displays are composed of various actions and modals that form a gestalt of an emotion display. For instance, prosody, facial expression, body posture, gesture, etc. Hence, human social interaction and emotion display are multimodal.