Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/34296
Title: Representing emotive meaning in visual images : a social semiotic approach
Authors: Feng, D
O'Halloran, KL
Keywords: Comics
Emotive behavior
Emotive meaning
Social semiotic approach
Visual representation
Issue Date: 2012
Publisher: North-Holland
Source: Journal of pragmatics, 2012, v. 44, no. 14, p. 2067-2084 How to cite?
Journal: Journal of pragmatics 
Abstract: This study examines how emotive meaning is represented in visual images using the semiotic resources of facial expression, touch and body orientation. Complementing the cognitive metaphorical interpretation, the visually represented emotive behaviors are theorized as partial iconic representations of real life behaviors, which are in turn indexes of emotion. Adopting a social semiotic approach, this paper formulates facial expression, touch, and body orientation as inter-related systems of meaning, the selection and combination of which constitutes a systemic functional "lexico-grammar" for analyzing and interpreting meaning making in visual imagery. The systems are then used to explain how emotive meanings are represented in comic books. The analysis shows that cartoonists' systemic choices for representing emotions are largely consistent with the coding accuracy of facial behaviors on the one hand, and style guidelines advocated in comic handbooks on the other. Through the examination of both American and Japanese comics, it is demonstrated that the social semiotic lexico-grammatical approach is not only effective in explaining the emotion resources in nonverbal behavior, but also useful for investigating cultural differences in the visual depiction of emotion. The systemic choices also provide artists with a framework to "design" emotion in creative visual media such as comics, and possibly in computer vision, game design and related domains.
URI: http://hdl.handle.net/10397/34296
ISSN: 0378-2166
DOI: 10.1016/j.pragma.2012.10.003
Appears in Collections:Journal/Magazine Article

Access
View full-text via PolyU eLinks SFX Query
Show full item record

SCOPUSTM   
Citations

16
Last Week
0
Last month
1
Citations as of Oct 19, 2018

WEB OF SCIENCETM
Citations

13
Last Week
0
Last month
0
Citations as of Oct 18, 2018

Page view(s)

103
Last Week
3
Last month
Citations as of Oct 21, 2018

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.