The State-of-the-Art in Twitter Sentiment Analysis: A Review and Benchmark Evaluation

被引:128
|
作者
Zimbra, David [1 ]
Abbasi, Ahmed [2 ,3 ]
Zeng, Daniel [4 ]
Chen, Hsinchun [5 ]
机构
[1] Santa Clara Univ, Operat Management & Informat Syst Dept, Santa Clara, CA 95053 USA
[2] Univ Virginia, Informat Technol Area, Charlottesville, VA USA
[3] Univ Virginia, Ctr Business Analyt, Charlottesville, VA USA
[4] Univ Arizona, Management Informat Syst Dept, Tucson, AZ 85721 USA
[5] Univ Arizona, Artificial Intelligence Lab, Tucson, AZ USA
基金
美国国家科学基金会;
关键词
Sentiment analysis; opinion mining; social media; twitter; benchmark evaluation; natural language processing; text mining;
D O I
10.1145/3185045
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Twitter has emerged as a major social media platform and generated great interest from sentiment analysis researchers. Despite this attention, state-of-the-art Twitter sentiment analysis approaches perform relatively poorly with reported classification accuracies often below 70%, adversely impacting applications of the derived sentiment information. In this research, we investigate the unique challenges presented by Twitter sentiment analysis and review the literature to determine how the devised approaches have addressed these challenges. To assess the state-of-the-art in Twitter sentiment analysis, we conduct a benchmark evaluation of 28 top academic and commercial systems in tweet sentiment classification across five distinctive data sets. We perform an error analysis to uncover the causes of commonly occurring classification errors. To further the evaluation, we apply select systems in an event detection case study. Finally, we summarize the key trends and takeaways from the review and benchmark evaluation and provide suggestions to guide the design of the next generation of approaches.
引用
收藏
页数:29
相关论文
共 50 条
  • [21] A Meta-Analysis of State-of-the-Art Electoral Prediction From Twitter Data
    Gayo-Avello, Daniel
    SOCIAL SCIENCE COMPUTER REVIEW, 2013, 31 (06) : 649 - 679
  • [22] Facial Sentiment Analysis Using AI Techniques: State-of-the-Art, Taxonomies, and Challenges
    Patel, Keyur
    Mehta, Dev
    Mistry, Chinmay
    Gupta, Rajesh
    Tanwar, Sudeep
    Kumar, Neeraj
    Alazab, Mamoun
    IEEE ACCESS, 2020, 8 : 90495 - 90519
  • [23] EMPOWERING BUSINESS THROUGH SENTIMENT ANALYSIS, STATE-OF-THE-ART MODELS, TRENDS, AND APPLICATIONS
    Calin, Mihnea Andrei
    Enache, Adina
    Florea, Diana
    Militaru, Gheorghe
    MANAGEMENT PERSPECTIVES IN THE DIGITAL TRANSFORMATION, 2019, : 652 - 663
  • [24] Frontier Analysis: A State-of-the-Art Review and Meta-Analysis
    Assaf, A. George
    Josiassen, Alexander
    JOURNAL OF TRAVEL RESEARCH, 2016, 55 (05) : 612 - 627
  • [25] A state-of-the-art review on uncertainty analysis of rotor systems
    Fu, Chao
    Sinou, Jean-Jacques
    Zhu, Weidong
    Lu, Kuan
    Yang, Yongfeng
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2023, 183
  • [26] Modeling and Analysis of Electric Motors: State-of-the-Art Review
    Bilgin, Berker
    Liang, Jianbin
    Terzic, Mladen V.
    Dong, Jianning
    Rodriguez, Romina
    Trickett, Elizabeth
    Emadi, Ali
    IEEE TRANSACTIONS ON TRANSPORTATION ELECTRIFICATION, 2019, 5 (03): : 602 - 617
  • [27] A review and analysis of the state-of-the-art research on productivity measurement
    Singh, H
    Motwani, J
    Kumar, A
    INDUSTRIAL MANAGEMENT & DATA SYSTEMS, 2000, 100 (5-6) : 234 - 241
  • [28] Mobile learning: a state-of-the-art review survey and analysis
    Sarrab, Mohamed
    Elbasir, Mahmoud
    INTERNATIONAL JOURNAL OF INNOVATION AND LEARNING, 2016, 20 (04) : 347 - 383
  • [29] State-of-the-art review of cognitive task analysis techniques
    Schraagen, JM
    Chipman, SF
    Shute, VJ
    COGNITIVE TASK ANALYSIS, 2000, : 467 - 487
  • [30] Comprehensive analysis on orthopedic drilling: A state-of-the-art review
    Jamil, Muhammad
    Rafique, Saima
    Khan, Aqib Mashood
    Hegab, Hussien
    Mia, Mozammel
    Gupta, Munish Kumar
    Song, Qinghua
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART H-JOURNAL OF ENGINEERING IN MEDICINE, 2020, 234 (06) : 537 - 561