Papers05:56
Chinese contentLDM：用递归最小二乘做跨层记忆检索，困惑度优于 mHC 与 AttnResLDM 把跨层信息传递改成可检索的线性记忆，400M 与 1.5B 规模困惑度都低于 mHC 和 AttnRes。
#mHC
2 stories · 0 in 7 days · 1 in 30 days
Stories, products and papers tagged "mHC", newest first.
10月15日
9月7日
DeepSeek-V4-Flash Residual Stream Analysis
The findings show that DeepSeek-V4-Flash uses only part of its four-stream capacity, with early mixing being crucial and late mixing providing minimal benefit.