Chinese contentMarcel Rød 发布世界最快分词器 Gigatoken，速度超 HuggingFace 千倍
Marcel Rød 搞了个 Gigatoken，比 HuggingFace 快上千倍，比 tiktoken 快百倍，跑 tokenizer 的抓紧试试。
#Marcel Rød
1 stories · 0 in 7 days · 0 in 30 days
Stories, products and papers tagged "Marcel Rød", newest first.
Jul 22
