User Satisfaction with AI-Generated Versus Human-Assisted Personality Reports: A Quasi-Experimental Study on Indian College Students

Abstract

This article explored the integration of AI and personality assessment (based on the BIG-5) in the field of psychology. The purpose of the study was to evaluate user satisfaction between a human-assisted personality report and an AI-generated personality report. This quasi-experimental study was conducted on 15 female and 15 male college students, aged between 18 and 25 years, residing in Lucknow, India. The findings suggest that both male and female participants preferred human-assisted personality reports more than AI-generated reports. To gauge user satisfaction, a 10-item User Satisfaction Scale was constructed. To measure internal consistency, we used the Cronbach’s alpha reliability test and estimated weak internal consistency (α = .501). Possible reasons for low reliability could be the inability to account for language preference, interactivity, a small sample size of 30 participants, and heterogeneous items. No significant difference in user satisfaction was found between male and female participants. Subsequent studies should take into account double-blind participation, language consistency, order effect, and homogeneous items for the scale.