From Form to Interaction: A Comparative Analysis of User Experience in Chinese and Western Chatbots

Ke Hu; Jiahan Xie; Ying Zhao

doi:10.62051/29qvvs66

Authors

Ke Hu
Jiahan Xie
Ying Zhao

DOI:

https://doi.org/10.62051/29qvvs66

Keywords:

Chatbots; User Experience (UX); Cross-Cultural Design; Natural Language Processing (NLP); Conversational Agents.

Abstract

Chatbots have evolved into sophisticated conversational agents, significantly reshaping human-computer interaction through their ability to simulate human-like conversation. This paper explores the evolution of chatbots, focusing on third-generation agents capable of engaging in complex dialogues and grasping context. Traditionally, research has centered on evaluating the fidelity of chatbot communication and users’ perception of interaction quality. However, recent discourse has emphasized the importance of user experience (UX), including emotional resonance and contextual awareness. Cultural background has also emerged as a significant determinant of UX, necessitating an examination of cultural differences in chatbot interactions. This study investigates the interaction dynamics between non-anthropomorphic chatbots and users from diverse cultural backgrounds. Through empirical study, we reveal how cultural subtleties impact UX design principles and user approval, and we put forward ideas for cross-cultural optimization. Our research advances our knowledge of how chatbots engage with people from different cultural backgrounds and provides useful guidance for creating chatbots that are sensitive to cultural differences.

Downloads

Download data is not yet available.

References

Li, L., Lee, K. Y., Emokpae, E., & Yang, S. B. (2021). What makes you continuously use chatbot services? Evidence from Chinese online travel agencies. Electron Mark, 1 - 25.

Haugeland, I. K. F., Følstad, A., Taylor, C., & Bjørkli, C. A. (2022). Understanding the user experience of customer service chatbots: An experimental study of chatbot interaction design. Int J Hum-Comput St, 161, 102788.

Følstad, A., & Brandtzaeg, P. B. (2020). Users' experiences with chatbots: findings from a questionnaire study. Quality and User Experience, 5 (1), 3.

Lianshui Xing&Zhang Xuerong (2023). On the Evolution of "Media Equivalence" in the Era of Intelligent Media: A Study on the Interaction between Zhihu Users and Social Robots. Journal of Fuzhou University (Philosophy and Social Sciences Edition) (06), 155 - 163+172.

Peng Bo (2023). Research on the Impact of Humanization of Chat Robots on Consumer Information Search. Industrial Technology Innovation (05), 42 - 44.

Chin, H., Song, H., Baek, G., Shin, M., Jung, C., Cha, M., ... & Cha, C. (2023). The Potential of Chatbots for Emotional Support and Promoting Mental Well-Being in Different Cultures: Mixed Methods Study. J Med Internet Res, 25, e51712.

Duijst, D. (2017). Can we improve the user experience of chatbots with personalization? Master's thesis. University of Amsterdam.

Skjuve, M., & Brandzaeg, P. B. (2019). Measuring user experience in chatbots: An approach to interpersonal communication competence. In Internet Science: INSCI 2018 International Workshops, St. Petersburg, Russia, October 24 – 26, 2018, Revised Selected Papers 5 (pp. 113-120). Springer International Publishing.

Liu, Y. L., Yan, W., Hu, B., Lin, Z., & Song, Y. (2023). Chatbots or humans? Effects of agent identity and information sensitivity on users’ privacy management and behavioral intentions: A comparative experimental study between China and the United States. International Journal of Human–Computer Interaction, 1 - 16.

Xu, K., Liu, F., Mou, Y., Wu, Y., Zeng, J., & Schäfer, M. S. (2020). Using machine learning to learn machines: A cross-cultural study of users’ responses to machine-generated artworks. J Broadcast Electron, 64 (4), 566 - 591.

Liu Qian, Liu Qingwei, Min Yong&Wu Ye (2023) AI Empowerment and Human Machine Coupling: Social Robots in the AIGC Era. Media (10), 23 - 25.

van Straten, C. L., Peter, J., Kühne, R., & Barco, A. (2022). On sharing and caring: Investigating the effects of a robot's self-disclosure and question-asking on children's robot perceptions and child-robot relationship formation. Comput Hum Behav, 129, 107135.

Shangguan Xin, Lv Junyu, Zhang Huanyu&Liu Lijun (2023). Design and Implementation of a Text Emotional Chat Robot System Based on Deep Learning. Softw Eng (04), 46 - 51. doi: 10.19644/j.cnki.issn2096 - 1472.2023.004.011.

Hoffmann, L., Krämer, N. C., Lam-Chi, A., & Kopp, S. (2009). Media equation revisited: do users show polite reactions toward an embodied agent? In Intelligent Virtual Agents: 9th International Conference, IVA 2009 Amsterdam, The Netherlands, September 14 - 16, 2009 Proceedings 9 (pp. 159-165). Springer Berlin Heidelberg.

Hui Yannian (2024). Artificial intelligence chatbots assist in ophthalmology and scientific paper writing. International Journal of Ophthalmology (01), 1 - 4.

You Lijiang (2023). Analysis of the Impact of Artificial Intelligence Chatbots and Suggestions for Countermeasures - Taking ChatGPT as an Example. Network Security Technology and Applications (12), 128 - 130.

Wang Yun&Li Qianqian (2024). Social Controversy and Research Prospects of Digital Intimate Relationships under the Development of Human-Computer Communication. Young Journalist (01), 60 - 64. doi: 10.15997/j.cnki.qnjz.20240010.002.

Chen Xinyi&Mao Mingfang (2023). Risk Issues and Governance of Social Robots. Journal of Hunan University of Administration (02), 78-86. doi: 10.16480/j.cnki.cn43-1326/c.2023.02.02.011.

Jian Yufan&Huang Yubo (2023). Human-computer interaction: replacing or enhancing interpersonal interaction—— Control Experiments on Social Robots from the Perspective of Role Theory. Journalism University (04), 75-90+122. doi: 10.20050/j.cnki. xwdx. 2023.04.009. j.cnki. xwdx. 2023. 04. 009.

Walther, J. B., & Bunz, U. (2005). The rules of virtual groups: Trust, liking, and performance in computer‐mediated communication. J Commun, 55 (4), 828 - 846.

Inbar, O., & Meyer, J. (2019). Politeness counts in perceptions of peacekeeping robots. Ieee T Hum-Mach Syst, 49 (3), 232 - 240.

Fu Ling (2023). Amazon released its AI chat robot "Q" for its cloud platform. Internet World (12), 60.

Deng Jun, Yi Xinyan, and Fu Shiting (2023). How can social robots enhance users' social presence? The role of emoticon valence in human intellectual dialogue interaction. Library and Information Knowledge (02), 29 - 39. doi: 10.13366/j.dik.2023.02 - 029.

Yan Dongqi, Chen Siyu&Zhang Hongzhong (2024). Human Machine Relations and Public Opinion under the Paradigm of Machine Behavior - A Review of Intelligent Communication Research in 2023. Educational Media Research (01), 15 - 21. doi: 10.19400/j.cnki.cn10-1407/g2.2024.01.005.

McCrae, R. R., & John, O. P. (1992). An introduction to the five‐factor model and its applications. J Pers, 60 (2), 175 - 215.

Luo Xin (2023). The Ecological Risks and Governance of Network Communication of Chat Robots: Taking ChatGPT as an Example. Young Journalist (07), 91-94. doi: 10.15997/j.cnki. qnjz.2023. 07. 026.

Han Xiu, Zhang Hongzhong, He Kang&Ma Siyuan (2021). The Masking Effect of Media Dependence: Do users feel lonelier as their level of quasi-social interaction with social robots increases International Press (09), 25 - 48. doi: 10.13495/j.cnki.cjjc.2021. 09. 002.

Zhong Zhijin&Li Qiong (2024). Research on the Social Role of Social Robots and Human Psychological Mechanisms in Human-Computer Interaction. Academic Research (01), 18 - 25.

Wang Rao (2023). Research on Social Robots in the Field of Communication Studies - Based on the Perspective of Human Machine Symbiosis. Chinese City Newspaper (11), 60 - 62. doi: 10.16763/j. cnki-1007 - 4643.2023.11.021

Mo, R., Fang, J., & Chang, B. (2023). From anthropomorphic attribution to alliance establishment: The effect of human-chatbot relationships on engagement. Adv Meth Pract Psych, 31 (9), 1742.

Huang Yangkun&Chen Changfeng (2023). Automation of Visual Communication and Aesthetic Construction of National Image: A Study of Computational Aesthetics Based on Twitter Social Robots. Modern Communication (Journal of Communication University of China) (08), 96 - 104. doi: 10.19997/j.cnki.xdcb.2023.08.016.

Zhang Xiaohui&Sun Jingling (2023). Talking about Virtual AI: An Analysis of Emotional Connection between Users and Chat Robots - Taking Software Replika as an Example. Modern Communication (Journal of Communication University of China) (09), 124 - 133. doi: 10.19997/j.cnki. xdcb.2023.09.006.