Please use this identifier to cite or link to this item:
http://hdl.handle.net/10397/107150
Title: | Photo-realistic image super-resolution via variational autoencoders | Authors: | Liu, ZS Siu, WC Chan, YL |
Issue Date: | Apr-2021 | Source: | IEEE transactions on circuits and systems for video technology, Apr. 2021, v. 31, no. 4, p. 1351-1365 | Abstract: | There is a great leap in objective accuracy on image super-resolution, which recently brings a new challenge on image super-resolution with larger up-scaling (e.g. 4× ) using pixel based distortion for measurement. This causes over-smooth effect which cannot grasp well the perceptual similarity. The advent of generative adversarial networks makes it possible super-resolve a low-resolution image to generate photo-realistic images sharing distribution with the high-resolution images. However, generative networks suffer from problems of mode-collapse and unrealistic sample generation. We propose to perform Image Super-Resolution via Variational AutoEncoders (SR-VAE) learning according to the conditional distribution of the high-resolution images induced by the low-resolution images. Given that the Conditional Variational Autoencoders tend to generate blur images, we add the conditional sampling mechanism to narrow down the latent subspace for reconstruction. To evaluate the model generalization, we use KL loss to measure the divergence between latent vectors and standard Gaussian distribution. Eventually, in order to balance the trade-off between super-resolution distortion and perception, not only that we use pixel based loss, we also use the modified deep feature loss between SR and HR images to estimate the reconstruction. In experiments, we evaluated a large number of datasets to make comparison with other state-of-the-art super-resolution approaches. Results on both objective and subjective measurements show that our proposed SR-VAE can achieve good photo-realistic perceptual quality closer to the natural image manifold while maintain low distortion. | Keywords: | Distortion Divergence Image super-resolution Variational autoencoders |
Publisher: | Institute of Electrical and Electronics Engineers | Journal: | IEEE transactions on circuits and systems for video technology | ISSN: | 1051-8215 | EISSN: | 1558-2205 | DOI: | 10.1109/TCSVT.2020.3003832 | Rights: | © 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The following publication Z. -S. Liu, W. -C. Siu and Y. -L. Chan, "Photo-Realistic Image Super-Resolution via Variational Autoencoders," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, no. 4, pp. 1351-1365, April 2021 is available at https://doi.org/10.1109/TCSVT.2020.3003832. |
Appears in Collections: | Journal/Magazine Article |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Liu_Photo-Realistic_Image_Super-Resolution.pdf | Pre-Published version | 3.89 MB | Adobe PDF | View/Open |
Page views
4
Citations as of Jun 30, 2024
Downloads
1
Citations as of Jun 30, 2024
SCOPUSTM
Citations
29
Citations as of Jun 21, 2024
WEB OF SCIENCETM
Citations
27
Citations as of Jun 27, 2024
![](/image/google_scholar.jpg)
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.