Sebastian Raschka calls for a modular LLM building-block API
The practical gap here is interoperability, not capability: open-source architecture variants already exist but are locked into incompatible codebases. Researchers running ablations, engineers evaluating architectures like Mamba2 versus attention, and labs publishing open-weight models would all gain from standardised, swappable components. Existing libraries such as Megatron Core and OLMo-core cover their own model families, so cross-family comparison still means manual porting today.