DRAFT：从 fMRI 信号和相机轨迹重建 3D 房间布局
DRAFT: Decoding and Reconstructing 3D Room Layouts from fMRI and Camera Trajectories
不靠一帧画面，只用脑部扫描和运动轨迹就能还原房间的 3D 结构，还当插件白给七个解码器涨分，思路挺妙。
DRAFT 是一个从 fMRI 信号重建 3D 房间布局的方法，只需参与者的脑信号和已知相机轨迹，不使用任何视觉帧。它从早期视觉皮层提取紧凑的布局表示，并与相机运动推导的几何自由空间融合。在 10 个 held-out 场景、20 名参与者上，DRAFT 达到 layout r 0.480，超过仅用相机路径的 0.446 和七个 fMRI 解码器的最高 0.429。作为即插即用模块，它还能把七个解码器的 layout r 从 0.171-0.429 提升到 0.487-0.493，且无需重新训练。
DRAFT: Decoding and Reconstructing 3D Room Layouts from fMRI and Camera Trajectories
While functional magnetic resonance imaging (fMRI) decoders reconstruct images and 3D objects, recovering the metric geometry of rooms from a moving viewpoint remains an open challenge. We introduce, to our knowledge for the first time, the task of reconstructing 3D layouts of held-out scenes using only the known camera trajectories and the fMRI signals of participants watching indoor walkthroughs, without any visual frames. The task is hard because of the temporal mismatch between rapid visual changes and blurred fMRI signals. Our method, DRAFT (Decoding and Reconstructing 3D room lAyouts from fMRI and Trajectories), extracts a compact layout representation from the early visual cortex and fuses this neural code with the geometric free space derived from camera motion. To evaluate it, we propose layout r, the Pearson correlation between predicted and ray-cast log depths. On ten held-out scenes (20 participants), DRAFT reaches a layout r of 0.480, outperforming the camera path alone (0.446) and seven fMRI decoders (at most 0.429). DRAFT also works as a plug-in that improves all seven decoders without retraining, raising their layout r from 0.171-0.429 to 0.487-0.493. Brain activity and camera motion can thus recover the metric layout of unseen rooms, a first step toward reconstructing the 3D spaces people see.
