Please use this identifier to cite or link to this item:
Title: Word embedding composition for data imbalances in sentiment and emotion classification
Authors: Xu, RF
Chen, T
Xia, YQ
Lu, Q 
Liu, B
Wang, X
Keywords: Sentiment analysis
Emotion classification
Imbalanced training
Word embedding
Semantic compositionality
Issue Date: 2015
Publisher: Springer
Source: Cognitive computation, 2015, v. 7, no. 2, p. 226-240 How to cite?
Journal: Cognitive computation 
Abstract: Text classification often faces the problem of imbalanced training data. This is true in sentiment analysis and particularly prominent in emotion classification where multiple emotion categories are very likely to produce naturally skewed training data. Different sampling methods have been proposed to improve classification performance by reducing the imbalance ratio between training classes. However, data sparseness and the small disjunct problem remain obstacles in generating new samples for minority classes when the data are skewed and limited. Methods to produce meaningful samples for smaller classes rather than simple duplication are essential in overcoming this problem. In this paper, we present an oversampling method based on word embedding compositionality which produces meaningful balanced training data. We first use a large corpus to train a continuous skip-gram model to form a word embedding model maintaining the syntactic and semantic integrity of the word features. Then, a compositional algorithm based on recursive neural tensor networks is used to construct sentence vectors based on the word embedding model. Finally, we use the SMOTE algorithm as an oversampling method to generate samples for the minority classes and produce a fully balanced training set. Evaluation results on two quite different tasks show that the feature composition method and the oversampling method are both important in obtaining improved classification results. Our method effectively addresses the data imbalance issue and consequently achieves improved results for both sentiment and emotion classification.
ISSN: 1866-9956 (print)
1866-9964 (online)
DOI: 10.1007/s12559-015-9319-y
Appears in Collections:Journal/Magazine Article

View full-text via PolyU eLinks SFX Query
Show full item record


Last Week
Last month
Citations as of Jul 7, 2018


Last Week
Last month
Citations as of Jul 16, 2018

Page view(s)

Last Week
Last month
Citations as of Jul 15, 2018

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.