Please use this identifier to cite or link to this item:
Title: Investigations on Mandarin aspiratory animations using an airflow model
Authors: Chen, F
Wang, L
Chen, H
Peng, G 
Issue Date: 2017
Publisher: Institute of Electrical and Electronics Engineers
Source: IEEE/ACM transactions on audio, speech, and language processing, 2017, v. 25, no. 12, p. 2399-2409 How to cite?
Journal: IEEE/ACM transactions on audio, speech, and language processing 
Abstract: Various three-dimensional (3-D) talking heads have been developed lately for language learning, with both external and internal articulatory movements being visualized to guide learning. Mandarin pronunciation animation is challenging due to its confusable stops and affricates with similar places of articulation. Until now, less attention has been paid to the biosignal information of aspiratory airflow, which is essential in distinguishing Mandarin consonants. This study fills a research gap by presenting the quantitative analyses of airflow, and then designing an airflow model for a 3-D pronunciation system. The airflow information was collected by Phonatory Aerodynamic System, so that confusable consonants in Mandarin could be discerned by mean airflow rate, peak airflow rate, airflow duration, and peak time. Based on the airflow parameters, an airflow model using the physical equation of fluid flow was proposed and solved, which was then combined and synchronized with the existing 3-D articulatory model. Therefore, the new multimodal system was implemented to synchronously exhibit the airflow motions and articulatory movements of uttering Mandarin syllables. Both an audio-visual perception test and a pronunciation training study were conducted to assess the effectiveness of our system. Perceptual results indicated that identification accuracy was improved for both native and nonnative groups with the help of airflow motions, while native perceivers exhibited higher accuracy due to long-term language experience. Moreover, our system helped Japanese learners of Mandarin enhance their production skills of Mandarin aspirated consonants, reflected by higher gain values of voice onset time after training.
ISSN: 2329-9290
EISSN: 2329-9304
DOI: 10.1109/TASLP.2017.2755400
Appears in Collections:Journal/Magazine Article

View full-text via PolyU eLinks SFX Query
Show full item record


Citations as of Apr 6, 2019


Last Week
Last month
Citations as of Apr 9, 2019

Page view(s)

Last Week
Last month
Citations as of May 21, 2019

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.