Thinkink:与LLM的二维空间墨水原生交互工具

Thinkink: 2D Spatial Ink-native Interaction with LLMs

精选理由

手写和草图也能和LLM对话了!Thinkink让你在画布上手写输入,LLM用墨水风格回复,研究还做了三轮用户测试,挺靠谱的。

AI 摘要

Thinkink是一个允许用户通过手写文本或草图与LLM交互的工具,LLM的响应以墨水风格文本和图形整合到共享2D画布中。研究包含三个阶段:形成性研究(N=12)分析了传统与数字手写实践;诊断性研究(N=6)识别了可用性与人-LLM交互挑战;最终研究(N=10)评估了Thinkink在构思场景中的使用效果。该工具利用语义树简化手写解释,并通过状态机提供轻量级显式控制。研究为墨水原生LLM交互提供了设计启示和具体原型。

原文 · arXiv cs.AI

Thinkink: 2D Spatial Ink-native Interaction with LLMs

People often use handwritten notes and sketches to externalize ideas for ideation. To integrate large language models (LLMs) into this practice, we propose Thinkink. Prompts can be handwritten text or drawn sketches with LLM-generated responses visualized as ink-like text and sketches spatially integrated into a shared canvas. A semantic tree streamlines ink interpretation, and a lightweight UI provides explicit control using a state machine. The tool was designed using a three-stage process. A formative study (N=12) examined current practices with conventional and digital inking methods. The results informed a technical probe for a diagnostic study (N=6) identifying usability and human-LLM interaction challenges. This motivated the design of Thinkink, with a final study (N=10) examining how people incorporate it into their ideation practices. We contribute design implications and a tool for ink-native LLM interaction where the user and LLM write and draw in a shared 2D canvas.