Abstract: When a constraint puzzle has several correct answers, language models tend to give the same one.We study four open-weight models from three families on symbolic puzzles and multi-solution ZebraLogic variants with exactly known solution sets.Repeated samples concentrate on one default solution far beyond uniform sampling, and different models
[…]
Content was trimmed to protect the source. Please visit the original article for the full text.
Read the original article:
Many Solutions, One Answer: Search Order Shapes the Default Solutions of Language Models
