前 Anthropic 研究员 Jacob Coxon 将在纽约市 AI 听证会作证，涉及"关停开关"法案
前 Anthropic 研究员Jacob Coxon直接告诉纽约议员说人类可能会失去对AI的控制，市里还准备立法强制模型过第三方验证，没过就罚款2.5万美元一次，还要求内置关停开关。
前 Anthropic 研究员 Jacob Coxon 向纽约市议员表示，人类很可能失去对 AI 的控制，并将在 NYC AI 听证会上作证，主题是 AI"kill switch"。纽约市正在筹备一项法案，要求所有在本地销售的 AI 模型必须先通过外部验证，未经验证的每次销售或部署将被罚款 2.5 万美元。该法案还要求模型具备关停能力，即人类操作者可以让模型临时或永久停止运行。验证方将评估准确性、校准、确定性、延迟、数据来源、偏见、隐私和安全，并向该市 Cyber Command 认证。
Ex-Anthropic researcher Jacob Coxon told New York City lawmakers that humans will probably lose control of AI and is set to testify at NYC AI hearing on ‘kill switches,’
New York City is also prepareing a bill that would require every AI model sold locally to pass outside validation first and would fine AI vendors $25K per unvalidated sale or deployment.
All 51 council members are weighing this lead bill that would outlaw marketing, selling or deploying any AI model in the city without outside validation.
It also requires a shutdown capability, meaning a human operator can technically make the model stop working, temporarily or permanently.
Validators would grade accuracy, calibration, determinism, latency, data provenance, bias, privacy and safety, then certify readiness to the city's Cyber Command.