CONGA:用于结构化贝叶斯推断的高斯纤维几何编译器

媒体报道 Hugging Face Papers 原文语言:中文

论文提出 CONGA 编译器,自动识别模型中的高斯块并生成相应的仿射映射,以加速结构化贝叶斯推断。实验证明,在 Stock‑Watson 通胀模型上提升 NUTS 采样效率 12.5 倍,并在高维电力负荷模型中恢复收敛。

全文

In structured Bayesian models, a large latent block is often Gaussian conditional on a smaller set of parameters, yet generic inference methods relearn this geometry during warmup. We study how this structure can be used to construct transports for posterior inference. The conditional mean and precision determine exact affine maps, including symmetric Brenier and triangular Knothe-Rosenblatt maps, that separate a standard normal block from the remaining non-Gaussian core. KL and relative Fisher objectives then reduce to objectives on this core. We introduce CONGA, a compiler that identifies candidate Gaussian blocks and selects a temporal, spectral, or sparse implementation according to their structure and computational cost. Marginalization requires an identity established from the model; numerical evidence alone permits only a target-preserving change of variables, and a failed check leaves the model unchanged. On the Stock-Watson inflation model, CONGA improves minimum ESS per second by 12.5x for NUTS. It also restores convergence where the raw target fails: for WALNUTS on the same model, and for NUTS on a 6760-dimensional electricity load model reduced to 34 core coordinates. Experiments on graph-indexed fields show how coloring and fill affect the choice of map, including cases where retaining the original target is preferable. Code at https://github.com/vicgalle/conga

View arXiv page View PDF GitHub 1 Add to collection

正文以来源语言显示。

参考来源

← 返回每日AI报告