Budget Internalization: Fixed-Budget RLVR Trades Test-Time Scaling for In-Budget Accuracy

arXiv:2611.26172v1 Announce Type: cross
Abstract: Reasoning models often become more accurate when they can generate longer answers at test time. This behavior is known as test-time scaling. However, RL with verifiable rewards (RLVR) usually trains them with a fixed rollout cap. We find that this cap changes model behavior, not only training cost. After training, models use few additional tokens

[…]
Content was trimmed to protect the source. Please visit the original article for the full text.

This article has been indexed from cs.AI updates on arXiv.org

Read today’s AI news roundups »