这篇论文用264k个婴儿触觉片段做对比学习,发现触觉对视觉学习的贡献比想象中大,推荐给研究婴儿认知或对比学习的读者。
该论文提出一种婴儿触摸事件的结构化编码系统,并构建了包含264k个两秒片段的触觉事件数据集。利用该数据集预训练的发展性模型揭示了触觉在婴儿视觉概念学习中的重要作用。研究量化了婴儿依赖触觉进行视觉学习的程度,为理解触觉在认知发展中的角色提供了依据。
Making Sense of Touch from the Child's View for Contrastive Learning
Is the sense of touch a mechanism for human babies' learning of visual concepts? If so, can we quantify its importance, and to what extent do babies rely on their sense of touch for visual learning? To approach these questions in a principled way, we propose a structured coding system for baby-centric touch events, yielding a dataset of 264k two-second clips of touch events coded according to this system. Using this dataset, we pretrain developmentally grounded models that reveal promising insights into the nature of baby learning from touch.