World Modeling in Transformers
This paper provides a detailed mechanistic analysis of how a transformer model represents and navigates a simulated environment, which could be useful for researchers working on similar tasks.
This paper provides a detailed mechanistic analysis of how a transformer model represents and navigates a simulated environment, which could be useful for researchers working on similar tasks.