技巧精选

Karpathy 建议:让 LLM 输出 HTML 作为视觉输出新方式

This works really well btw, at the end of your que…

精选理由

Karpathy 的这个技巧让 AI 输出从枯燥文本变成可视化页面,做演示、写文档或做数据分析的团队可以直接用,省去手动排版时间。

AI 摘要

AI 研究员 Andrej Karpathy 在 X 上分享了一个实用技巧:在对话结束时让 LLM 将回答结构化为 HTML,然后在浏览器中查看生成的文件。他认为,音频是人类偏好的输入方式,而视觉(图像/动画/视频)是偏好的输出方式。他预测 AI 输出将从纯文本、Markdown 向 HTML 演进,最终走向交互式神经视频/模拟。他还指出,输入方面需要增加指向/手势等交互方式。目前阶段,他建议尝试让 LLM 输出 HTML 以提升信息接收效率。

原文 · Andrej Karpathy

This works really well btw, at the end of your que…

This works really well btw, at the end of your query ask your LLM to "structure your response as HTML", then view the generated file in your browser. I've also had some success asking the LLM to present its output as slideshows, etc.

More generally, imo audio is the human-preferred input to AIs but vision (images/animations/video) is the preferred output from them. Around a ~third of our brains are a massively parallel processor dedicated to vision, it is the 10-lane superhighway of information into brain. As AI improves, I think we'll see a progression that takes advantage:

1) raw text (hard/effortful to read) 2) markdown (bold, italic, headings, tables, a bit easier on the eyes) <-- current default 3) HTML (still procedural with underlying code, but a lot more flexibility on the graphics, layout, even interactivity) <-- early but forming new good default ...4,5,6,... n) interactive neural videos/simulations

Imo the extrapolation (though the technology doesn't exist just yet) ends in some kind of interactive videos generated directly by a diffusion neural net. Many open questions as to how exact/procedural "Software 1.0" artifacts (e.g. interactive simulations) may be woven together with neural artifacts (diffusion grids), but generally something in the direction of the recently viral https://t.co/z21CP5iQfu

There are also improvements necessary and pending at the input. Audio nor text nor video alone are not enough, e.g. I feel a need to point/gesture to things on the screen, similar to all the things you would do with a person physically next to you and your computer screen.

TLDR The input/output mind meld between humans and AIs is ongoing and there is a lot of work to do and significant progress to be made, way before jumping all the way into neuralink-esque BCIs and all that. For what's worth exploring at the current stage, hot tip try ask for HTML.

Karpathy 建议:让 LLM 输出 HTML 作为视觉输出新方式 · AI 热点