MIST model improves cancer survival prediction
MIST: Multimodal Survival Prediction with Genomic-Guided Histology Attention
This research presents a new approach for multimodal data fusion in medical AI, which could lead to more accurate predictions for patient outcomes.
A new model called MIST combines whole-slide images and genomic data to predict patient survival.
It uses a method called genomic-guided histology attention to fuse the information more effectively.In tests on four different types of cancer, MIST outperformed standard methods by improving the C-index metric.
MIST: Multimodal Survival Prediction with Genomic-Guided Histology Attention
Multimodal survival models can combine complementary prognostic information from whole-slide images and genomic profiles, but effective fusion remains challenging amid external cohort shift and computational complexity. To address these challenges, we propose MIST, multimodal survival prediction with genomic-guided histology attention. MIST represents genomic features as tokens and allows them to query compact foundation-model-derived histology context tokens before survival prediction. This design enriches molecular information with histology context rather than merging separately encoded modalities only at the final stage. Training combines discrete-time survival prediction with genomic feature masking, WSI dropout, and paired WSI-genomics contrastive alignment. Across four external evaluations in colon, renal, lung, and glioblastoma cohorts, MIST improves external C-index over standard fusion baselines in the primary comparisons. These results support genomic-guided histology attention as a compact and effective strategy for multimodal oncology outcome prediction. Our code is available at https://github.com/samiyavuuz/MIST .
This report is categorized under AITOP's "Papers" desk, focusing on US frontier AI labs and Silicon Valley technology leaders. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include MIST, multimodal, cancer, medical AI.
Source attribution: curated from arXiv cs.AI (@Muhammet Sami Yavuz, Sabri Mustafa Kahya, Richard R. Chen, Jana Lipkova, Benedikt Wiestler).