iFlytek Spark-X2.6-4B Launches With 1M-Token Context Under Apache 2.0
A 4B model handling a 1M-token context window pushes long-document workloads onto small hardware, making local long-context inference practical on consumer GPUs. The Apache 2.0 license allows unrestricted commercial use, a contrast to models with usage restrictions. Developers building retrieval-free long-context applications can deploy it directly through vLLM.
iFlytek's SparkLLM team released Spark-X2.6-4B, a 4B-parameter open-source model with a 1M-token context window. The model is licensed under Apache 2.0 and supports controllable thinking, letting users switch the reasoning process on or off as needed. The vLLM project added day-one support for running the model at launch.
1M tokens of context. 4B parameters. Apache 2.0. Controllable thinking.
Spark-X2.6-4B is live, and vLLM serves it day 0. Congrats to the @SparkLLM team! 📷