Ensemble Routing for Prompt-Adaptive Cost-Aware LLM Inference

Research Hugging Face Papers Source language: Chinese

论文摘要(作者报告,未经本站复测):Large language models (LLMs) increasingly support Web-based services that must balance response quality and inference cost across heterogeneous requests.

Excerpt

论文摘要(作者报告,未经本站复测):Large language models (LLMs) increasingly support Web-based services that must balance response quality and inference cost across heterogeneous requests.

Short excerpt from the source — open the original for the full text.

Sources

← Back to the daily brief