AITOPAI热报
Papers

Microsoft 研究员在 Science 提出“反向对齐”：用神经网络思路重塑制度

Every technological revolution has remodeled our institutions – how might AI? In @ScienceMagazine, ...

官方账号Microsoft Research@MSFTResearch
Post
View the post
Why we picked it

微软研究员在 Science 上写了篇文章，把神经网络当成改造社会制度的模板，还起了个新词叫反向对齐，思路挺新颖。

Microsoft Research 研究员 Glen Weyl 与 James Evans 在 Science 杂志发表文章，提出“反向对齐”概念。文章主张把神经网络的运作方式当作模型，用来重新设计人类社会制度。作者认为这条路径能在获取 AI 收益的同时管控其风险。

Image · Microsoft Research
Original · Microsoft Research

Every technological revolution has remodeled our institutions – how might AI? In @ScienceMagazine, ...

Every technological revolution has remodeled our institutions – how might AI? In @ScienceMagazine , Microsoft researcher @glenweyl and co-author @profjamesevans explore ‘reverse alignment,’ the idea that using neural networks as a model for reshaping institutions might offer a path toward harnessing the benefits of AI while managing its risks. msft.it/6015aAHYP 💬 3 🔄 0 ❤️ 6 👀 1299 📊 3 ⚡

#Microsoft Research#反向对齐#AI治理

Keep reading

Recent stories with the same tag or section
How-toBuildersSelected04:05
Microsoft Research's Proof-Driven Development Kit Verifies AI-Generated Code

Formal methods have rarely been applied to code that agents write, and PDD Kit shows a workflow where the tool both verifies and honestly reports coverage gaps instead of guessing. Developers building agent pipelines that ship unreviewed code can use the kit to set machine-checked intent specs. Microsoft's open position here contrasts with runtime-only testing approaches used by most coding assistant vendors.

#Microsoft#PDD Kit#Verus#coding assistants
官方账号Microsoft Research@MSFTResearchSource
PapersBuildersSelected03:04
Microsoft Research and Georgia Tech release MANDATE agent failure taxonomy

The counterintuitive finding is that the failures users report most often, like agents burning compute without progress, are the ones researchers study least, leaving a blind spot for anyone deploying agents in production. Teams building or evaluating agent products can use the 23-category taxonomy as a checklist for user-facing risk testing and post-incident review.

#Microsoft Research#MANDATE#AI agents#AI safety
DAIR.AI@dair_aiSource
PapersBuildersSelected12:49
Behavioral Self-Rewarding Lifts Qwen3-14B on SWE-bench

The method requires no new environment interactions, so teams can layer it onto existing reward setups without extra rollout cost. Researchers and engineers training coding agents on sparse test-based rewards get a concrete fix for zero-variance groups, with the bounded-reward design showing how to keep self-judgement from overriding ground-truth correctness. It compares against standard GRPO-style binary reward training on Qwen3-14B.

#Qwen3#SWE-bench#Microsoft Research#reinforcement learning
DAIR.AI@dair_aiSource