Hugging Face Papers ↗ · 2026-11-13
Choosing Quantized Code LLMs by File Size and Energy per Solved Task
Media reports Hugging Face Papers Source language: Chinese
Excerpt
论文摘要(作者报告,未经本站复测):A developer running a code assistant on a laptop downloads one model file, and local inference moves the energy of every request onto that machine. A common rule says a larger model at lower precision tends to beat a smaller one at higher precision.
Short excerpt from the source — open the original for the full text.