Please use this identifier to cite or link to this item:
Title: Realistic human action recognition With multimodal feature selection and fusion
Authors: Wu, Q
Wang, Z
Deng, F
Chi, Z 
Feng, DD
Issue Date: 2013
Publisher: Institute of Electrical and Electronics Engineers
Source: IEEE transactions on systems, man, and cybernetics. Systems, 2013, v. 43, no. 4, p. 875-885 How to cite?
Journal: IEEE transactions on systems, man, and cybernetics. Systems 
Abstract: Although promising results have been achieved for human action recognition under well-controlled conditions, it is very challenging to recognize human actions in realistic scenarios due to increased difficulties such as dynamic backgrounds. In this paper, we propose to take multimodal (i.e., audiovisual) characteristics of realistic human action videos into account in human action recognition for the first time, since, in realistic scenarios, audio signals accompanying an action generally provide a cue to the nature of the action, such as phone ringing to answering the phone . In order to cope with diverse audio cues of an action in realistic scenarios, we propose to identify effective features from a large number of audio features with the generalized multiple kernel learning algorithm. The widely used space-time interest point descriptors are utilized as visual features, and a support vector machine is employed for both audio- and video-based classifications. At the final stage, fuzzy integral is utilized to fuse recognition results of both audio and visual modalities. Experimental results on the challenging Hollywood-2 Human Action data set demonstrate that the proposed approach is able to achieve better recognition performance improvement than that of integrating scene context. It is also discovered how audio context influences realistic action recognition from our comprehensive experiments.
ISSN: 2168-2216
EISSN: 2168-2232
DOI: 10.1109/TSMCA.2012.2226575
Appears in Collections:Journal/Magazine Article

View full-text via PolyU eLinks SFX Query
Show full item record


Last Week
Last month
Citations as of Nov 14, 2018


Last Week
Last month
Citations as of Nov 17, 2018

Page view(s)

Last Week
Last month
Citations as of Nov 19, 2018

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.