Abstract: Diffusion language models offer an architectural route to low-budget generation by updating multiple tokens in parallel, which can reduce the number of sequential decoding steps relative to token-by-token autoregressive decoding. However, realizing this advantage at low budgets is challenging, as generation quality often declines when the number
[…]
Content was trimmed to protect the source. Please visit the original article for the full text.
Read the original article:
Closing Performance Gap for Diffusion Language Models under Low Inference Budgets
