Perplexity 被称为最强 agent 编排器:一个 webcam 画音乐应用为例
有人用 Perplexity 做了个应用,摄像头前随手画几笔就能出音乐,底层是 MediaPipe 手势追踪加 Web Audio。作者认为 Perplexity 当 agent 编排器比单一模型更顺手,做这类交互小工具的开发者可以参考这个思路。
Jeff Grimes 发推称 Perplexity 是目前最好的 agent 编排器,并展示了一个由 Perplexity 生成的 webcam 画音乐应用作为例证。
该应用受 @measure_plan 启发,用户可以用手势在摄像头前涂鸦来“画”出音乐。技术上,应用基于 MediaPipe/WASM 手部追踪,跑在 web worker 中,实现了多帧 pinch 检测与实时平滑处理。
涂鸦的高度映射为量化后的音高,水平位置决定四个 Web Audio 乐器中任一乐器的循环时机。这条推文获得 61 个点赞、约 6272 次浏览。
这更像一个开发者经验分享:与其纠结单一模型选型,用 Perplexity 编排 agent 来完成这类多组件(视觉追踪、音频合成、交互逻辑)的前端应用已经可行。
Perplexity is the best agent orchestrator Jeff Grimes @jeffgrimes9 Perplexity made this app that lets you draw music with your webcam, inspired by @measure_plan . It's built with MediaPipe/WASM tracking in a web worker, with multi-frame pinch detection and live smoothing. Each scribble's height sets quantized pitch, and its horizontal position sets loop timing for any of four Web Audio instruments.
This report is categorized under AITOP's "How-to" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include Perplexity, MediaPipe, Web Audio, agents.
Source attribution: curated from Aravind Srinivas (@AravSrinivas).