Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/64591
Title: A new framework with multiple tasks for detecting and locating pain events in video
Authors: Chen, JK
Chi, ZR 
Fu, H
Keywords: Pain event detection
Pain event locatin
P-HOG
HOG-TOP
Probabilistic fusion
Multiple kernel fusion
Issue Date: 2017
Publisher: Academic Press
Source: Computer vision and image understanding, 2017, v. 155, p. 113-123 How to cite?
Journal: Computer vision and image understanding 
Abstract: Automatically detecting and locating pain events in video is an important task in medical assessment. It is a challenging problem in facial expression analysis due to spontaneous faces, head movements and pose variations. In this paper, we explore the role of facial information at various time scales (frame, segment and sequence) and propose a new framework for pain event detection and locating in video. We introduce a feature-level fusion method for pain event detection and a multiple-task fusion method for locating pain events, respectively. Both spatial and spatial-temporal features are utilized in our study. At first, we employ the histogram of oriented gradients (HOG) of fiducial points(P-HOG) to extract spatial features from each video frame and train an SVM as a frame-based pain event detector. Secondly, HOG from Three Orthogonal Planes (named as HOG-TOP) is used to characterize the dynamic textures of a video segment, a segment-based classifier (SVM) is then trained for segment-level detection. We further apply a max pooling strategy to obtain the global P-HOG and HOG-TOP to represent the whole video sequence and a multiple kernel fusion is employed to find an optimal feature-level fusion. An SVM with multiple kernels is trained to perform sequence-level (pain event) detection. Finally, an effectiveprobabilistic fusion method is proposed to integrate the detection results of the three different tasks (frame level, segment-level and sequence-level detection) to locate pain events in video. Extensive experiments conducted on the UNBC-McMaster Shoulder Pain database show that our proposed method outperforms other state-of-the-art methods both in pain event detection and locating in video. Our sequence-level event detection method has also been applied to facial expression recognition in video with good results.
URI: http://hdl.handle.net/10397/64591
ISSN: 1077-3142
DOI: 10.1016/j.cviu.2016.11.003
Appears in Collections:Journal/Magazine Article

Access
View full-text via PolyU eLinks SFX Query
Show full item record

Page view(s)

74
Last Week
2
Last month
Checked on Oct 15, 2017

Google ScholarTM

Check

Altmetric



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.