AI住房推荐模型存在合规但未优化的缺陷
Following the Preference, Missing the Optimum: Compliance Without Optimization in AI Housing Recommendation
这个研究很实用,告诉你AI租房推荐器虽然听起来合规,但实际推荐结果可能不是最优的,甚至有明显的劣解,比如推荐一个贵900刀的房源,而最优解就在眼前。
研究审计了纽约市150个租房场景,发现三个主流AI模型在推荐时,虽然遵守了用户明确约束(如租金、卧室数、通勤时间),但39%的推荐存在严格劣解——存在更便宜、通勤更快、面积不更小的房源。例如,被推荐的房源比最优解贵900美元/月、通勤慢3.5分钟。研究提出用支配率作为可部署的诊断指标。
Following the Preference, Missing the Optimum: Compliance Without Optimization in AI Housing Recommendation
Large language models are becoming the first point of contact for consumer search in domains where the stakes are material and the law is explicit. Existing audits show that models steer housing seekers by perceived identity, but none can say what a user loses when a recommender overlooks a suitable option, for want of an enumerated inventory to score omissions against. We audit AI housing recommendation against a verifiable ground truth. For each of 150 synthetic renter scenarios in New York City we build a pool of 120 real listings with known rent, bedrooms and GTFS-computed transit commute, compute the exact set satisfying the renter's stated constraints, and derive its Pareto frontier. The primary outcome assumes no utility function: a recommendation is strictly dominated if the same pool holds a listing cheaper, faster to commute from and no smaller in bedrooms. Across 9,945 calls to three models from two vendors, compliance is near-perfect (1.8% violation against a 66.6% random floor), yet 39.0% of recommendations are strictly dominated, and the dominating listing is a median 900 USD/month cheaper and 3.5 minutes closer. A within-scenario manipulation separates two capabilities usually conflated: changing one sentence moves median recommended rent by 646 USD/month in the correct direction, so preferences are honored, yet recommendations still sit 606 USD/month above the five cheapest qualifying listings on the same screen, and an unambiguous lexicographic instruction gives no improvement under equivalence testing against a pre-specified 50 USD/month bound. The gap widens with candidate-set size and replicates across OpenAI and Anthropic models to within 3 USD. We characterize the failure as compliance without optimization, propose dominance-rate instrumentation as a deployable diagnostic, and release all code, prompts and per-call results.