Transformer-Based Video Comment Analysis

Abstract

In this work, we conduct a comprehensive analysis of sentiment in Bilibili comments using a Transformer-based model. We employ the mT5_m2o_chinese_simplified_crossSum model, a multitasking Transformer model specifically designed for summarizing Chinese text. The study involves scraping comments from a video related to the "trolley problem," followed by data cleaning and preprocessing. The preprocessed data is fed into the Transformer model, which generates summaries that accurately reflect the main viewpoints and discussions in the comments. Our results show that the model effectively captures key ethical dilemmas, personal opinions, and emotional responses, providing a nuanced understanding of public sentiment. This research highlights the potential of advanced NLP techniques in processing large volumes of user-generated content, offering valuable insights for businesses and researchers in understanding public opinion and facilitating ethical discussions. The study underscores the importance of optimizing Transformer models for specific tasks, demonstrating their flexibility and performance in text summarization. These findings provide a robust foundation for future applications and innovations in natural language processing.