Ensemble Routing for Prompt-Adaptive Cost-Aware LLM Inference

研究论文 Hugging Face Papers 原文语言:中文

论文摘要(作者报告,未经本站复测):Large language models (LLMs) increasingly support Web-based services that must balance response quality and inference cost across heterogeneous requests.

原文摘录

论文摘要(作者报告,未经本站复测):Large language models (LLMs) increasingly support Web-based services that must balance response quality and inference cost across heterogeneous requests.

以下是来源提供的简短摘录,完整内容请查看原文。

参考来源

← 返回每日简报