Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/109338
PIRA download icon_1.1View/Download Full Text
DC FieldValueLanguage
dc.contributorDepartment of Chinese and Bilingual Studies-
dc.contributorResearch Institute for Smart Ageing-
dc.creatorZhang, Y-
dc.creatorChen, X-
dc.creatorChen, S-
dc.creatorMeng, Y-
dc.creatorLee, A-
dc.date.accessioned2024-10-03T08:18:06Z-
dc.date.available2024-10-03T08:18:06Z-
dc.identifier.urihttp://hdl.handle.net/10397/109338-
dc.language.isoenen_US
dc.publisherFrontiers Research Foundationen_US
dc.rights© 2023 Zhang, Chen, Chen, Meng and Lee. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY) (http://creativecommons.org/licenses/by/4.0/). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.en_US
dc.rightsThe following publication Zhang Y, Chen X, Chen S, Meng Y and Lee A (2023) Visual-auditory perception of prosodic focus in Japanese by native and non-native speakers. Front. Hum. Neurosci. 17:1237395 is available at https://doi.org/10.3389/fnhum.2023.1237395.en_US
dc.subjectCantoneseen_US
dc.subjectFocus perceptionen_US
dc.subjectJapaneseen_US
dc.subjectMulti-sensory perceptionen_US
dc.subjectProsodic focusen_US
dc.subjectVisual-auditory integrationen_US
dc.titleVisual-auditory perception of prosodic focus in Japanese by native and non-native speakersen_US
dc.typeJournal/Magazine Articleen_US
dc.identifier.volume17-
dc.identifier.doi10.3389/fnhum.2023.1237395-
dcterms.abstractIntroduction: Speech communication is multi-sensory in nature. Seeing a speaker’s head and face movements may significantly influence the listeners’ speech processing, especially when the auditory information is not clear enough. However, research on the visual-auditory integration speech processing has left prosodic perception less well investigated than segmental perception. Furthermore, while native Japanese speakers tend to use less visual cues in segmental perception than in other western languages, to what extent the visual cues are used in Japanese focus perception by the native and non-native listeners remains unknown. To fill in these gaps, we test focus perception in Japanese among native Japanese speakers and Cantonese speakers who learn Japanese, using auditory-only and auditory-visual sentences as stimuli.-
dcterms.abstractMethodology: Thirty native Tokyo Japanese speakers and thirty Cantonese-speaking Japanese learners who had passed the Japanese-Language Proficiency Test with level N2 or N3 were asked to judge the naturalness of 28 question-answer pairs made up of broad focus eliciting questions and three-word answers carrying broad focus, or contrastive or non-contrastive narrow focus on the middle object words. Question-answer pairs were presented in two sensory modalities, auditory-only and visual-auditory modalities in two separate experimental sessions.-
dcterms.abstractResults: Both the Japanese and Cantonese groups showed weak integration of visual cues in the judgement of naturalness. Visual-auditory modality only significantly influenced Japanese participants’ perception when the questions and answers were mismatched, but when the answers carried non-contrastive narrow focus, the visual cues impeded rather than facilitated their judgement. Also, the influences of specific visual cues like the displacement of eyebrows or head movements of both Japanese and Cantonese participants’ responses were only significant when the questions and answers were mismatched. While Japanese participants consistently relied on the left eyebrow for focus perception, the Cantonese participants referred to head movements more often.-
dcterms.abstractDiscussion: The lack of visual-auditory integration in Japanese speaking population found in segmental perception also exist in prosodic perception of focus. Not much foreign language effects has been found among the Cantonese-speaking learners either, suggesting a limited use of facial expressions in focus marking by native and non-native Japanese speakers. Overall, the present findings indicate that the integration of visual cues in perception of focus may be specific to languages rather than universal, adding to our understanding of multisensory speech perception.-
dcterms.accessRightsopen accessen_US
dcterms.bibliographicCitationFrontiers in human neuroscience, 2023, v. 17, 1237395-
dcterms.isPartOfFrontiers in human neuroscience-
dcterms.issued2023-
dc.identifier.scopus2-s2.0-85173937206-
dc.identifier.eissn1662-5161-
dc.identifier.artn1237395-
dc.description.validate202410 bcch-
dc.description.oaVersion of Recorden_US
dc.identifier.FolderNumberOA_Scopus/WOSen_US
dc.description.fundingSourceOthersen_US
dc.description.fundingTextHong Kong Polytechnic Universityen_US
dc.description.pubStatusPublisheden_US
dc.description.oaCategoryCCen_US
Appears in Collections:Journal/Magazine Article
Files in This Item:
File Description SizeFormat 
fnhum-17-1237395.pdf1.47 MBAdobe PDFView/Open
Open Access Information
Status open access
File Version Version of Record
Access
View full-text via PolyU eLinks SFX Query
Show simple item record

Page views

24
Citations as of Nov 24, 2024

Downloads

8
Citations as of Nov 24, 2024

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.