Please use this identifier to cite or link to this item:
http://hdl.handle.net/10397/105480
Title: | Hybrid refinement-correction heatmaps for human pose estimation | Authors: | Kamel, A Sheng, B Li, P Kim, J Feng, DD |
Issue Date: | 2021 | Source: | IEEE transactions on multimedia, 2021, v. 23, p. 1330-1342 | Abstract: | In this paper, we present a method (Hybrid-Pose) to improve human pose estimation in images. We adopt Stacked Hourglass Networks to design two convolutional neural network models, RNet for pose refinement and CNet for pose correction. The CNet (Correction Network) guides the pose refinement RNet (Refinement Network) to correct the joint location before generating the final pose. Each of the two models is composed of four hourglasses, and each hourglass generates a group of detection heatmaps for the joints. The RNet model hourglasses have the same structure. However, the CNet model is designed with hourglasses of different structures for pose guidance. Since the pose estimation in RGB images is very sensitive to the image scene, our proposed approach generates multiple outputs of detection heatmaps to broaden the searching scope for the correct joints locations. We use the RNet model to refine the joints locations in each hourglass stage horizontally, then the heatmaps of each stage are fused with the heatmaps of all the CNet model hourglasses vertically in a hybrid manner. Our method shows competitive results with the existing state-of-the-art approaches on MPII and FLIC benchmark datasets. Although our proposed method focuses on improving single-person pose estimation, we also show the influence of this improvement on multi-person pose estimation by detecting multiple people using SSD detector, then estimating the pose of each person individually. | Keywords: | Heatmaps fusion Human pose estimation Pose correction Pose refinement |
Publisher: | Institute of Electrical and Electronics Engineers | Journal: | IEEE transactions on multimedia | ISSN: | 1520-9210 | EISSN: | 1941-0077 | DOI: | 10.1109/TMM.2020.2999181 | Rights: | © 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The following publication A. Kamel, B. Sheng, P. Li, J. Kim and D. D. Feng, "Hybrid Refinement-Correction Heatmaps for Human Pose Estimation," in IEEE Transactions on Multimedia, vol. 23, pp. 1330-1342, 2021 is available at https://doi.org/10.1109/TMM.2020.2999181. |
Appears in Collections: | Journal/Magazine Article |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Li_Hybrid_Refinement-Correction_Heatmaps.pdf | Pre-Published version | 38.08 MB | Adobe PDF | View/Open |
Page views
27
Citations as of Jul 7, 2024
Downloads
20
Citations as of Jul 7, 2024
SCOPUSTM
Citations
35
Citations as of Jul 4, 2024
WEB OF SCIENCETM
Citations
26
Citations as of Jul 4, 2024
![](/image/google_scholar.jpg)
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.