#4-bit quantization

5 stories · 0 in 7 days · 0 in 30 days
Stories, products and papers tagged "4-bit quantization", newest first.
Sep 24
PapersBuildersMulti-source09:58
Chinese content五款 7B-8B 开源模型土耳其语文档问答评测:本地 6GB 显卡跑出 49%-75% 准确率

有人在 6GB 显存的笔记本上,用土耳其语 109 页报告实测了五款 7B-8B 开源模型,还顺手证明花哨检索方案打不过 TF-IDF,做 RAG 的可以看看。

Event
arXiv cs.LG@Imtiaz Ul Hassan et al. (7)Source
Jul 31
Jul 23
Jun 19
May 20