PapersSelected

Audit finds cultural bias in text-to-image prompt revisions

Prompt Revision as a Source of Cultural Bias in Text-to-Image Systems

Why we picked it

This matters because it identifies a new, previously unknown source of cultural bias in popular AI image generators, showing that the systems themselves may be shaping the output in ways users don't see.

A new study introduces WORLDVIEW, a multilingual benchmark of 8,960 prompts, to audit how commercial text-to-image systems like DALL-E-3, Imagen-4, and GPT-Image-1.5 revise user prompts. The research finds that these systems mark non-Western and non-Anglophone cultural contexts more heavily, flatten them into narrow, stereotypical vocabularies, and that this revision layer itself is a previously undocumented source of stereotyping.

Original · arXiv cs.AI

Prompt Revision as a Source of Cultural Bias in Text-to-Image Systems

Commercial text-to-image systems silently revise user prompts before generating images, a step users typically cannot disable or even see. Yet, existing audits of cultural bias examine only the final images and treat generation as a single pipeline, so they cannot tell where the bias originates. We introduce WORLDVIEW, a multilingual benchmark of 8,960 prompts across 15 languages and 31 language-context pairings. Using it, we audit the revision layer in three systems (DALL-E-3, Imagen-4, GPT-Image-1.5) through a three-step analysis of how heavily it marks each cultural context, whether it flattens that context into a narrow vocabulary, and whether that vocabulary is stereotypical. Relative to a no-context English baseline, the US is the least-marked context, while non-Western and non-Anglophone contexts are marked far more heavily, flattened into narrow vocabularies applied across topically diverse prompts, and reduced to recognizable cultural stereotypes. Comparing images from original versus revised prompts on models without a revision layer, we identify the layer itself as a previously undocumented, causal source of this stereotyping. To locate cultural bias, and fix it, we must audit the system as deployed, not the model alone.