PostHog engineer on moving from product engineering to AI product engineering
The interesting shift here is that eval writing becomes a core product engineering skill rather than a research activity, and the human-vs-agent boundary becomes the main design decision. Engineers on traditional product teams, especially those near platform or SDK work, can use this as a realistic roadmap: build with agents, study their failure modes, and practise elastic evals on real features. His country-level signup-count example shows exactly the kind of silent regression evals are meant to catch.