Hugging Face Papers ↗ · 2026-11-17
Thinking Harder Doesn't Lead to Better Choices: Reasoning Effort Increases the Confidence but Not the Correctness of LLM Shopping Agents
Media reports Hugging Face Papers Source language: Chinese
Across three shopping benchmarks, increasing large language model shopping agents' thinking effort did not statistically improve product-choice quality but significantly raised reported confidence, and most models were poorly calibrated with correlated errors.
Full text
Across three shopping benchmarks, increasing large language model shopping agents' thinking effort did not statistically improve product-choice quality but significantly raised reported confidence, and most models were poorly calibrated with correlated errors.