Please use this identifier to cite or link to this item:
http://hdl.handle.net/10397/95825
Title: | Discovering financial hypernyms by prompting masked language models | Authors: | Peng, B Chersoni, E Hsu, YY Huang, CR |
Issue Date: | Jun-2022 | Source: | In M El-Haj, P Rayson & N Zmandar (Eds.), Proceedings of the 4th Financial Narrative Processing Workshop (FNP 2022), p. 10-16. Paris: European Language Resources Association (ELRA). | Abstract: | With the rising popularity of Transformer-based language models, several studies have tried to exploit their masked language modeling capabilities to automatically extract relational linguistic knowledge, although this kind of research has rarely investigated semantic relations in specialized domains. The present study aims at testing a general-domain and a domain-adapted Transformer model on two datasets of financial term-hypernym pairs using the prompt methodology. Our results show that the differences of prompts impact critically on models’ performance, and that domain adaptation to financial texts generally improves the capacity of the models to associate the target terms with the right hypernyms, although the more successful models are those which retain a general-domain vocabulary. | Keywords: | Transformers Semantic relations Language modeling Financial natural language processing |
Publisher: | European Language Resources Association (ELRA) | ISBN: | 979-10-95546-74-0 | Description: | 4th Financial Narrative Processing Workshop FNP 2022, Language Resources and Evaluation Conference, 24 June 2022, Marseille, France | Rights: | © European Language Resources Association (ELRA) These workshop proceedings are licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (https://creativecommons.org/licenses/by-nc/4.0/) The following publication Peng, B., Chersoni, E., Hsu, Y. Y., & Huang, C. R. (2022, June). Discovering Financial Hypernyms by Prompting Masked Language Models. In M. El-Haj, P. Rayson & N. Zmandar (Eds.), Proceedings of the 4th Financial Narrative Processing Workshop (FNP 2022) (pp. 10-16). Paris: European Language Resources Association (ELRA) is available at http://www.lrec-conf.org/proceedings/lrec2022/workshops/FNP/index.html |
Appears in Collections: | Conference Paper |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Peng_Financial_Hypernyms_Language.pdf | 366.24 kB | Adobe PDF | View/Open |
Page views
66
Last Week
0
0
Last month
Citations as of May 19, 2024
Downloads
20
Citations as of May 19, 2024
Google ScholarTM
Check
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.