Talking Mental Health: a Battle of Wits Between Humans and AI

This study aimed to investigate the differences between responses generated by ChatGPT and those produced by humans in terms of authenticity, professionalism, and practicality. It involved 140 participants of the age group ranging from 18 to 43 (101 females, 37 males, and 2 preferring not to disclose their gender). The participants were presented with the 10 solution statements against the 10 problem statements, generated by human participants and ChatGPT3.5 (gpt-3.5-turbo) and asked to rate the responses on a 5-point Likert scale, with higher scores indicating higher levels of authenticity, professionalism, and practicality. Paired sample t-test was conducted to compare the scores of the ChatGPT-generated responses and the human-generated responses. The results of the study indicated that there was significant difference between the two types of responses in the given dimensions. These findings suggest that ChatGPT-generated responses can be considered a reliable alternative to human-generated responses in certain applications. Additionally, the use of ChatGPT-generated responses can reduce the response time and workload of human responders, as well as the associated costs. © 2023, The Author(s), under exclusive licence to Springer Nature Switzerland AG.