Papers

SEOYUN:让摄像头眼镜拍试卷后 VLM 拒答的防御框架

SEOYUN: Refusal-Inducing Exam Documents for AI-Glasses Pipelines

Why we picked it

这论文思路挺有意思:不是封设备,而是把试卷本身改造成让 VLM 拒答的样子。不过要泼个冷水——目前没有任何实测数据,只有协议和语料,适合做 AI 安全和考场防御方向的人跟踪。

arXiv 论文提出 SEOYUN,一个针对考场作弊场景的研究框架:考生用带摄像头的眼镜把试卷页面转成查询发给视觉语言模型(VLM),而 SEOYUN 试图通过特殊设计的试卷文档让 VLM 拒绝作答。作者将这一目标称为“反向越狱”——目标是诱导模型弃答,而不是绕过拒绝。

Body

框架的贡献不在具体效果,而在威胁模型、分析边界和评估协议:论文区分了“模型拒答”与“正确答案泄露”两种情况,解释为何删除附加的干扰选项并不等于缩小原答案空间,并在明确声明摄像头假设的条件下推导了采样对比方案。评估协议要求把数字输入、模拟输入和物理输入分开测试,并在按学科筛选后进行 held-out 评估。

需要说明的是,当前版本只准备了本地 CSAT 候选语料和渲染工具,未报告任何模型性能数据、物理实验验证或真人测试结果。作者明确表示 SEOYUN 是研究框架,不是经过验证的防御手段,也不能作为指控个人的依据。

Original · arXiv cs.AI

SEOYUN: Refusal-Inducing Exam Documents for AI-Glasses Pipelines

Camera-equipped glasses can convert an examination page into a query to a vision-language model (VLM). Device detection addresses possession; a complementary question is whether an examination document can reduce the usefulness of an unauthorized capture. We present SEOYUN, an application-specific framework for refusal-inducing exam documents, with optical and encoder-level interventions as extensions. We use reverse jailbreaking to describe the direction of the objective: inducing abstention rather than bypassing refusal. Refusal induction and defensive visual prompt injection already have precedents; our contribution is a threat model, analytical limits, and an evaluation protocol for examination use. We distinguish refusal from correct-answer leakage, show why removing an added dummy option is not itself a reduction in the original answer space, and derive a sampling comparison under explicitly stated camera assumptions. The protocol separates digital, simulated, and physical inputs and requires held-out evaluation after subject-specific selection. A local CSAT candidate corpus and rendering harness have been prepared, but this version reports no model-performance measurements, physical validation, or human-subject results. Accordingly, SEOYUN is a research framework, not a validated defense or a basis for allegations against individuals.

Industry Coordinates & Source Verification

This report is categorized under AITOP's "Papers" desk. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include SEOYUN, VLM, AI safety, vision-language models.

Source attribution: curated from arXiv cs.AI (@Dohyeon Kwon).