Apple Introduces Tri-Modal Masked Diffusion Models
Pretraining diffusion models across three modalities from scratch departs from the dominant recipe of finetuning a unimodal checkpoint, potentially simplifying how text, image and audio generation are unified in one architecture. Researchers and engineers working on discrete diffusion or multimodal models can reuse its scaling-law findings and sampling defaults. Apple's publication puts it in direct conversation with autoregressive approaches from labs like OpenAI and Google.