Saif, Hassan; Fernández, Miriam; He, Yulan and Alani, Harith
(2014).
|
PDF (Version of Record)
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (478kB) | Preview |
| URL: | http://lrec2014.lrec-conf.org/en/ |
|---|---|
| Google Scholar: | Look up in Google Scholar |
Abstract
Sentiment classification over Twitter is usually affected by the noisy nature (abbreviations, irregular forms) of tweets data. A popular procedure to reduce the noise of textual data is to remove stopwords by using pre-compiled stopword lists or more sophisticated methods for dynamic stopword identification. However, the effectiveness of removing stopwords in the context of Twitter sentiment classification has been debated in the last few years. In this paper we investigate whether removing stopwords helps or hampers the effectiveness of Twitter sentiment classification methods. To this end, we apply six different stopword identification methods to Twitter data from six different datasets and observe how removing stopwords affects two well-known supervised sentiment classification methods. We assess the impact of removing stopwords by observing fluctuations on the level of data sparsity, the size of the classifier’s feature space and its classification performance. Our results show that using pre-compiled lists of stopwords negatively impacts the performance of Twitter sentiment classification approaches. On the other hand, the dynamic generation of stopword lists, by removing those infrequent terms appearing only once in the corpus, appears to be the optimal method to maintaining a high classification performance while reducing the data sparsity and substantially shrinking the feature space.
| Item Type: | Conference or Workshop Item | ||||||
|---|---|---|---|---|---|---|---|
| Copyright Holders: | 2014 European Language Resources Association | ||||||
| ISBN: | 2-9517408-8-3, 978-2-9517408-8-4 | ||||||
| Project Funding Details: |
|
||||||
| Keywords: | sentiment analysis; stopwords; data sparsity | ||||||
| Academic Unit/School: | Faculty of Science, Technology, Engineering and Mathematics (STEM) > Knowledge Media Institute (KMi) Faculty of Science, Technology, Engineering and Mathematics (STEM) |
||||||
| Research Group: | Centre for Research in Computing (CRC) | ||||||
| Item ID: | 40666 | ||||||
| Depositing User: | Kay Dave | ||||||
| Date Deposited: | 06 Aug 2014 08:25 | ||||||
| Last Modified: | 07 Dec 2018 14:55 | ||||||
| URI: | http://oro.open.ac.uk/id/eprint/40666 | ||||||
| Share this page: |     |
Download history for this item
These details should be considered as only a guide to the number of downloads performed manually. Algorithmic methods have been applied in an attempt to remove automated downloads from the displayed statistics but no guarantee can be made as to the accuracy of the figures.
CORE (COnnecting REpositories)
CORE (COnnecting REpositories)