Abstract: Reasoning models often become more accurate when they can generate longer answers at test time. This behavior is known as test-time scaling. However, RL with verifiable rewards (RLVR) usually trains them with a fixed rollout cap. We find that this cap changes model behavior, not only training cost. After training, models use few additional tokens
[…]
Content was trimmed to protect the source. Please visit the original article for the full text.
Read the original article:
Budget Internalization: Fixed-Budget RLVR Trades Test-Time Scaling for In-Budget Accuracy
