AXA AI Research preprint benchmarks energy per token for discrete diffusion versus autoregressive language models
On 14 Oct 2026 an arXiv preprint (v1) from Boris Ruf and Marcin Detyniecki of AXA AI Research in Paris, France reports a comparative energy benchmark of the di…
Published on MyPrivateClaw
Oct 16, 2026, 6:47 AM UTC
Coverage date
Oct 15, 2026
Last updated
Oct 16, 2026, 6:47 AM UTC
News summary
On 14 Oct 2026 an arXiv preprint (v1) titled "Energy Consumption Analysis of Discrete Diffusion and Autoregressive Language Models" was submitted by Boris Ruf and Marcin Detyniecki of AXA AI Research in Paris, France. The preprint performs a comparative energy benchmark of the discrete diffusion models LLaDA 8B and Dream 7B against autoregressive baselines Llama 3.1 8B and Qwen 2.5 7B. The paper reports that at longer sequences (200–600 tokens), diffusion models achieved 2.5–2.7 J/token, approximately twice as efficient as AR models with KV cache at 5.3–5.7 J/token, and that KV cache provided 50–70% energy reduction for AR models at longer sequences. These figures were benchmarked on compact 7–8B parameter models under controlled AXA experimental settings, and the benchmark covers only models of that size, so the measured J/token figures may not generalize to larger scale models. The wo…