Hugging Face Papers ↗ · 2026-11-16
VAE节奏:用于AI生成视频检测的时间解码痕迹
媒体报道 Hugging Face Papers 原文语言:中文
研究提出利用生成模型解码过程中的周期性误差——VAE Rhythm——来无训练检测AI生成视频。通过相位扫描测量重建误差的周期性,在39种生成器中均能发现该痕迹,并将其作为零-shot评分或检测器插件使用,显著提升多种基准检测器的AUROC,最高超过90%。
全文
Visible artifacts are an unreliable cue for detecting generated videos, because newer generators learn to remove them. We instead detect a trace left by the generation pipeline itself. Most video generators decode latents with a 3D causal VAE that groups consecutive frames in time, so the fidelity of generated frames rises and falls periodically with their position in a group. We call this periodic trace VAE Rhythm. Real videos are captured frame by frame and do not have it. To reveal it without training, we propose a phase scan. The scan reconstructs a clip with an off-the-shelf VAE from successive start offsets and measures the periodicity of the reconstruction error across these offsets. We find VAE Rhythm in most of the 39 variants of 31 generators we test, including the closed-source Sora, Kling 3.0 and Seedance 2.0. We use the rhythm as a zero-shot score, as a plug-in for existing detectors and as a data engine that pairs real videos with their VAE reconstructions to train our detector CaDet. On DF26, the training-free rhythm score outperforms all 15 retrained baselines, and as a plug-in it improves all 19 tested detectors by 6.7% to 23.7% AUROC. CaDet achieves the best AUROC on AIGVDBench, DF26 and three 2026 closed-source models, and its variant trained without any generated video still exceeds 90% on AIGVDBench.
View arXiv page View PDF Project page GitHub 1 Add to collection
正文以来源语言显示。