The State-of-the-Art in Twitter Sentiment Analysis: A Review and Benchmark Evaluation

被引:128
|
作者
Zimbra, David [1 ]
Abbasi, Ahmed [2 ,3 ]
Zeng, Daniel [4 ]
Chen, Hsinchun [5 ]
机构
[1] Santa Clara Univ, Operat Management & Informat Syst Dept, Santa Clara, CA 95053 USA
[2] Univ Virginia, Informat Technol Area, Charlottesville, VA USA
[3] Univ Virginia, Ctr Business Analyt, Charlottesville, VA USA
[4] Univ Arizona, Management Informat Syst Dept, Tucson, AZ 85721 USA
[5] Univ Arizona, Artificial Intelligence Lab, Tucson, AZ USA
基金
美国国家科学基金会;
关键词
Sentiment analysis; opinion mining; social media; twitter; benchmark evaluation; natural language processing; text mining;
D O I
10.1145/3185045
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Twitter has emerged as a major social media platform and generated great interest from sentiment analysis researchers. Despite this attention, state-of-the-art Twitter sentiment analysis approaches perform relatively poorly with reported classification accuracies often below 70%, adversely impacting applications of the derived sentiment information. In this research, we investigate the unique challenges presented by Twitter sentiment analysis and review the literature to determine how the devised approaches have addressed these challenges. To assess the state-of-the-art in Twitter sentiment analysis, we conduct a benchmark evaluation of 28 top academic and commercial systems in tweet sentiment classification across five distinctive data sets. We perform an error analysis to uncover the causes of commonly occurring classification errors. To further the evaluation, we apply select systems in an event detection case study. Finally, we summarize the key trends and takeaways from the review and benchmark evaluation and provide suggestions to guide the design of the next generation of approaches.
引用
收藏
页数:29
相关论文
共 50 条
  • [1] State-of-the-art review on Twitter Sentiment Analysis
    Alshammari, Norah Fahad
    AlMansour, Amal Abdullah
    2019 2ND INTERNATIONAL CONFERENCE ON COMPUTER APPLICATIONS & INFORMATION SECURITY (ICCAIS), 2019,
  • [2] On the evaluation and combination of state-of-the-art features in Twitter sentiment analysis
    Jonnathan Carvalho
    Alexandre Plastino
    Artificial Intelligence Review, 2021, 54 : 1887 - 1936
  • [3] On the evaluation and combination of state-of-the-art features in Twitter sentiment analysis
    Carvalho, Jonnathan
    Plastino, Alexandre
    ARTIFICIAL INTELLIGENCE REVIEW, 2021, 54 (03) : 1887 - 1936
  • [4] A Review and Benchmark on State-of-the-Art Steel Defects Detection
    Chazhoor A.A.P.
    Ho E.S.L.
    Gao B.
    Woo W.L.
    SN Computer Science, 5 (1)
  • [5] A Review on Arabic Sentiment Analysis: State-of-the-Art, Taxonomy and Open Research Challenges
    Abo, Mohamed Elhag Mohamed
    Raj, Ram Gopal
    Qazi, Atika
    IEEE ACCESS, 2019, 7 : 162008 - 162024
  • [6] AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languages
    Muhammad, Shamsuddeen Hassan
    Abdulmumin, Idris
    Ayele, Abinew Ali
    Ousidhoum, Nedjma
    Adelani, David Ifeoluwa
    Yimam, Seid Muhie
    Ahmad, Ibrahim Sa'id
    Beloucif, Meriem
    Mohammad, Saif M.
    Ruder, Sebastian
    Hourrane, Oumaima
    Brazdil, Pavel
    Jorge, Alipio
    Ali, Felermino Dario Mario Antonio
    David, Davis
    Osei, Salomey
    Bello, Bello Shehu
    Ibrahim, Falalu
    Gwadabe, Tajuddeen
    Rutunda, Samuel
    Belay, Tadesse
    Messelle, Wendimu Baye
    Balcha, Hailu Beshada
    Chala, Sisay Adugna
    Gebremichael, Hagos Tesfahun
    Opoku, Bernard
    Arthur, Steven
    2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2023), 2023, : 13968 - 13981
  • [7] Sentiment Analysis in Hindi-A Survey on the State-of-the-art Techniques
    Kulkarni, Dhanashree S.
    Rodd, Sunil S.
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2022, 21 (01)
  • [8] A State-of-the-art Review of Cytotoxicity Evaluation of Biomaterials
    Ma F.
    Yu Y.
    Zhang J.
    Chen H.
    Cailiao Daobao/Materials Review, 2018, 32 (01): : 76 - 85
  • [9] Post-occupancy evaluation: State-of-the-art analysis and state-of-the-practice review
    Li, Peixian
    Froese, Thomas M.
    Brager, Gail
    BUILDING AND ENVIRONMENT, 2018, 133 : 187 - 202
  • [10] Outperforming State-of-the-Art Systems for Aspect-Based Sentiment Analysis
    Talafha, Bashar
    Al-Ayyoub, Mahmoud
    Abuammar, Analle
    Jararweh, Yaser
    2019 IEEE/ACS 16TH INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS (AICCSA 2019), 2019,