这项研究解决了AI审美评估中主观性强的痛点,做个性化推荐、图像编辑或用户体验优化的团队值得关注——它用LLM访谈替代了传统问卷,效果甚至超过本人复评,建议点开看看实验设计。
该研究提出了一种结合深度学习与大型语言模型(LLM)的系统,用于个性化图像审美评估。系统通过LLM进行半结构化访谈主动收集用户的审美偏好,并提取图像的高层语义特征与低层特征进行预测。实验表明,该系统在预测个体审美评价上优于传统模型、人类预测者,甚至目标个体自身的重新评估。尤其在高评分图像上表现突出,且预测误差小于个体自身的时间波动。研究暗示AI可能比他人或未来的自己更能捕捉特定时刻的个体审美偏好,引发AI能否成为比人类更深刻审美解释者的新问题。
AI Outperforms Humans in Personalized Image Aesthetics Assessment via LLM-Based Interviews and Semantic Feature Extraction
Accurately predicting individual aesthetic evaluation for images is a fundamental challenge for AI. Various deep learning (DL)-based models have been proposed for this task, training on image evaluation data to extract objective low-level features. However, aesthetic preferences are inherently subjective and individual-dependent. Accurate prediction thus requires the extraction of high-level semantic features of images and the active collection of preference information from the target individual. To address this issue, we focus on the utility of Large Language Models (LLMs) pretrained on vast amounts of textual data, and develop an integrated DL-LLM system. The system actively elicits aesthetic preferences through LLM-based semi-structured interviews and predicts aesthetic evaluation by leveraging both low-level and high-level features. In our experiments, we compare the proposed system against conventional systems, human predictors, and the target individual's own re-evaluations after a certain time interval. Our results show that the proposed system outperforms all of them, with particularly strong performance on highly-rated images. Moreover, the prediction error of the proposed system is smaller than within-person variability, while human predictors show the largest error, likely due to the influence of their own aesthetic values. These results suggest that AI may be better positioned than others or one's future self to capture individual aesthetic preferences at a given point. This opens a new question of whether AI could serve as a deeper interpreter of human aesthetic sensibility than humans themselves.