Please use this identifier to cite or link to this item:
http://hdl.handle.net/10397/106886
Title: | Two-dimensional multi-scale perceptive context for scene text recognition | Authors: | Li, H Yang, D Huang, S Lam, KM Jin, L Zhuang, Z |
Issue Date: | 6-Nov-2020 | Source: | Neurocomputing, 6 Nov. 2020, v. 413, p. 410-421 | Abstract: | Inspired by speech recognition, most of the recent state-of-the-art works convert scene text recognition into sequence prediction. Like most speech recognition problems, context modeling is considered as a critical component in these methods for achieving better performance. However, they usually only consider using a holistic or single-scale local sequence context, in a single dimension. Actually, scene texts or sequence contexts may span arbitrarily across a two-dimensional (2-D) space and in any style, not limited to only horizontal. Moreover, contexts of various scales may synthetically contribute to text recognition, in particular for irregular text recognition. In our method, we consider the context in a 2-D manner, and simultaneously consider context reasoning at various scales, from local to global. Based on this, we propose a new Two-Dimensional Multi-Scale Perceptive Context (TDMSPC) module, which performs multi-scale context learning, along both the horizontal and vertical directions, and then merges them. This can generate shape and layout-dependent feature maps for scene text recognition. This proposed module can be handily inserted into existing sequence-based frameworks to replace their context learning mechanism. Furthermore, a new scene text recognition network, called TDMSPC-Net, is built, by using the TDMSPC module as a building block for the encoder, and adopting an attention-based LSTM as the decoder. Experiments on benchmark datasets show that the TDMSPC module can substantially boost the performance of existing sequence-based scene text recognizers, irrespective of the decoder or backbone network being used. The proposed TDMSPC-Net achieves state-of-the-art accuracy on all the benchmark datasets. | Keywords: | Multi-scale perceptive context Scene text recognition Two-dimensional context |
Publisher: | Elsevier BV | Journal: | Neurocomputing | ISSN: | 0925-2312 | EISSN: | 1872-8286 | DOI: | 10.1016/j.neucom.2020.06.071 | Rights: | © 2020 Elsevier B.V. All rights reserved. © 2020. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/ The following publication Li, H., Yang, D., Huang, S., Lam, K. M., Jin, L., & Zhuang, Z. (2020). Two-dimensional multi-scale perceptive context for scene text recognition. Neurocomputing, 413, 410-421 is available at https://doi.org/10.1016/j.neucom.2020.06.071. |
Appears in Collections: | Journal/Magazine Article |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Lam_Two-Dimensional_Multi-Scale_Perceptive.pdf | Pre-Published version | 3.57 MB | Adobe PDF | View/Open |
Page views
4
Citations as of Jun 30, 2024
Downloads
3
Citations as of Jun 30, 2024
![](/image/google_scholar.jpg)
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.