BERT Model with Fuzzy Logic Optimization on Multivariate Sentiment Analysis Tasks
DOI:
https://doi.org/10.62051/48xrya81Keywords:
component; BERT; fuzzy logic; sentiment analysis; multivariate classification.Abstract
With the development of natural language processing techniques, sentiment analysis techniques are constantly updated. However, most of the sentiment analysis techniques are limited to handling binary sentiment analysis and perform poorly on multivariate sentiment analysis tasks. This paper explores the optimization in the field of sentiment analysis by using the BERT model combined with fuzzy logic to improve the performance of the model on multivariate sentiment classification tasks. The study uses the Twitter comments dataset and aims to gain insights into the challenges and optimization strategies of sentiment analysis models when dealing with multivariate sentiment. First, a single BERT model is experimentally demonstrated to perform better in binary classification tasks compared to multivariate classification tasks, highlighting its adaptability for simple sentiment classification and providing a basis for comparative experiments for multivariate classification experiments. To further improve the performance in multivariate sentiment analysis, fuzzy logic is introduced in this paper, and through the integration of this fuzzy logic, the accuracy of the BERT model on the multivariate sentiment classification task is successfully improved. The results of the study not only reveal the superiority of a single BERT model in binary classification but also emphasize the importance of incorporating fuzzy logic when facing multivariate sentiment analysis.
Downloads
References
C. Zucco, H. Liang, G. D. Fatta, & M. Cannataro. Explainable sentiment analysis with applications in medicine. 2018 IEEE Inter. Conf. Bioinform. Biome. , 1740-1747, 2018.
N. Akhtar, N. Zubair, A. Kumar, & T. Ahmad, Aspect based Sentiment Oriented Summarization of Hotel Reviews. Procedia Comput. Sci., 115, 563-571, 2017.
O. Alqaryouti, N. Siyam, A. A. Monem, & K. F. Shaalan, Aspect-based sentiment analysis using smart government review data. Appl. Comput. Inform., 2020.
G. Ansari, S. Shukla, M. Gupta, & H. Gupta, A Fuzzy Approach for Opinion Summarization of Product Reviews. 2022 Inter. Conf. Cognit. Comput. Inform. Process., 1-6, (2022).
L. A. Zadeh, Calculus of fuzzy restrictions, 1996.
L. A. Zadeh, Fuzzy logic. Computer, 21(4), 83-93, 1988.
S. Hosgurmath, V. Petli, & V. K. Jalihal, An omicron variant tweeter sentiment analysis using NLP technique. Global Trans. Proceed., 3(1), 215-219, 2022.
J. Devlin, M. Chang, K. Lee, & K. Toutanova, BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. 2023 https://arxiv.org/abs/1810.04805
L. Deping, W. Hongjuan, L. Mengyang, & L. Pei, News text classification based on Bidirectional Encoder Representation from Transformers, May 2021.
R. Cai, B. Qin, Y. Chen, L. Zhang, R. Yang, S. Chen, & W. Wang, Sentiment Analysis About Investors and Consumers in Energy Market Based on BERT-BiLSTM. IEEE Access, 8, 171408-171415, 2020.
Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need. Advances in neural information processing systems, 2017,30.
Downloads
Published
Conference Proceedings Volume
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.