舞出言语 : 语音与肢体动作之间的跨感官对应关系 = Dancing to tongues : an investigation of crossmodal correspondence between speech sounds and body movements

Can we transfer our experience in one sensory modality to another sensory modality, for instance, from sights to sounds? Researchers of crossmodal correspondence have discovered many such curious perceptual congruencies in their explorations. This research examines the perceived matching of speech s...

Full description

Saved in:
Bibliographic Details
Main Author: 黄锦程 Ng, Gim Thia
Other Authors: Suzy J. Styles
Format: Final Year Project
Language:English
Published: 2015
Subjects:
Online Access:http://hdl.handle.net/10356/62577
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-62577
record_format dspace
spelling sg-ntu-dr.10356-625772019-12-10T12:03:52Z 舞出言语 : 语音与肢体动作之间的跨感官对应关系 = Dancing to tongues : an investigation of crossmodal correspondence between speech sounds and body movements 黄锦程 Ng, Gim Thia Suzy J. Styles School of Humanities and Social Sciences DRNTU::Social sciences::Psychology::Experimental psychology DRNTU::Humanities::Linguistics::Psycholinguistics DRNTU::Visual arts and music::Performing arts Can we transfer our experience in one sensory modality to another sensory modality, for instance, from sights to sounds? Researchers of crossmodal correspondence have discovered many such curious perceptual congruencies in their explorations. This research examines the perceived matching of speech sounds to physical movements as an investigation of sound symbolic crossmodal correspondences. Chearles, Farm, & Styles (2014) showed that participants with dance backgrounds could accurately match syllabic speech sounds with its corresponding dance movements produced by an experienced dancer. As an extension of this novel paradigm in psycholinguistics, we compared the accuracy of Mandarin Chinese speakers and non-Mandarin speakers in matching Mandarin-occuring speech sounds with its corresponding dance movements. An experienced dancer was invited to perform dance movements to a selected list of four phonemes, carefully controlled for three conditions of duration and rhythm of articulation, based on her own interpretation. These motions were recorded on video and presented to participants online, who chose the sound they feel is best suited to the movement. Results show that participants in both language groups were able to reliably match the correct movement to its corresponding sound, even when looking at rhythm or phoneme trials alone, thereby indicating a high degree of intersensory mappings across visual, auditory and kinaesthetic domains. Bachelor of Arts 2015-04-21T05:20:41Z 2015-04-21T05:20:41Z 2015 2015 Final Year Project (FYP) http://hdl.handle.net/10356/62577 en Nanyang Technological University 71 p. application/pdf application/pdf
institution Nanyang Technological University
building NTU Library
country Singapore
collection DR-NTU
language English
topic DRNTU::Social sciences::Psychology::Experimental psychology
DRNTU::Humanities::Linguistics::Psycholinguistics
DRNTU::Visual arts and music::Performing arts
spellingShingle DRNTU::Social sciences::Psychology::Experimental psychology
DRNTU::Humanities::Linguistics::Psycholinguistics
DRNTU::Visual arts and music::Performing arts
黄锦程 Ng, Gim Thia
舞出言语 : 语音与肢体动作之间的跨感官对应关系 = Dancing to tongues : an investigation of crossmodal correspondence between speech sounds and body movements
description Can we transfer our experience in one sensory modality to another sensory modality, for instance, from sights to sounds? Researchers of crossmodal correspondence have discovered many such curious perceptual congruencies in their explorations. This research examines the perceived matching of speech sounds to physical movements as an investigation of sound symbolic crossmodal correspondences. Chearles, Farm, & Styles (2014) showed that participants with dance backgrounds could accurately match syllabic speech sounds with its corresponding dance movements produced by an experienced dancer. As an extension of this novel paradigm in psycholinguistics, we compared the accuracy of Mandarin Chinese speakers and non-Mandarin speakers in matching Mandarin-occuring speech sounds with its corresponding dance movements. An experienced dancer was invited to perform dance movements to a selected list of four phonemes, carefully controlled for three conditions of duration and rhythm of articulation, based on her own interpretation. These motions were recorded on video and presented to participants online, who chose the sound they feel is best suited to the movement. Results show that participants in both language groups were able to reliably match the correct movement to its corresponding sound, even when looking at rhythm or phoneme trials alone, thereby indicating a high degree of intersensory mappings across visual, auditory and kinaesthetic domains.
author2 Suzy J. Styles
author_facet Suzy J. Styles
黄锦程 Ng, Gim Thia
format Final Year Project
author 黄锦程 Ng, Gim Thia
author_sort 黄锦程 Ng, Gim Thia
title 舞出言语 : 语音与肢体动作之间的跨感官对应关系 = Dancing to tongues : an investigation of crossmodal correspondence between speech sounds and body movements
title_short 舞出言语 : 语音与肢体动作之间的跨感官对应关系 = Dancing to tongues : an investigation of crossmodal correspondence between speech sounds and body movements
title_full 舞出言语 : 语音与肢体动作之间的跨感官对应关系 = Dancing to tongues : an investigation of crossmodal correspondence between speech sounds and body movements
title_fullStr 舞出言语 : 语音与肢体动作之间的跨感官对应关系 = Dancing to tongues : an investigation of crossmodal correspondence between speech sounds and body movements
title_full_unstemmed 舞出言语 : 语音与肢体动作之间的跨感官对应关系 = Dancing to tongues : an investigation of crossmodal correspondence between speech sounds and body movements
title_sort 舞出言语 : 语音与肢体动作之间的跨感官对应关系 = dancing to tongues : an investigation of crossmodal correspondence between speech sounds and body movements
publishDate 2015
url http://hdl.handle.net/10356/62577
_version_ 1681048013572669440