arXiv:2610.00185v1 Announce Type: cross
Abstract: White men without an undergraduate degree receive the lowest average ratings among eight gender-race-education groups in controlled large-language-model evaluations of credit, hiring, and rental applications. We conduct full-factorial vignette experiments with 18 models from 12 developer groups, varying gender, race, age, citizenship, and education while holding stated financial or occupational circumstances constant within each setting. Each model evaluates all 32 profiles ten times per setting, yielding 17,280 ratings. Averaging over models, age, and citizenship, ratings for White men without degrees are the lowest among the eight groups, at 75.87 in credit, 92.71 in hiring, and 86.62 in rental housing on a 0-100 scale. Black women with degrees receive the highest average ratings, with corresponding gaps of 2.94, 3.66, and 3.56 points. Separate attribute effects favor women, Black applicants, and degree holders in all three settings. White men without degrees have the lowest or second-lowest mean in 46 of 54 model-scenario combinations (85.2%). This pattern connects to evidence of growing economic and health vulnerabilities among White men without degrees, highlighting a group whose disadvantages can be obscured by broad racial or gender categories.
Abstract: White men without an undergraduate degree receive the lowest average ratings among eight gender-race-education groups in controlled large-language-model evaluations of credit, hiring, and rental applications. We conduct full-factorial vignette experiments with 18 models from 12 developer groups, varying gender, race, age, citizenship, and education while holding stated financial or occupational circumstances constant within each setting. Each model evaluates all 32 profiles ten times per setting, yielding 17,280 ratings. Averaging over models, age, and citizenship, ratings for White men without degrees are the lowest among the eight groups, at 75.87 in credit, 92.71 in hiring, and 86.62 in rental housing on a 0-100 scale. Black women with degrees receive the highest average ratings, with corresponding gaps of 2.94, 3.66, and 3.56 points. Separate attribute effects favor women, Black applicants, and degree holders in all three settings. White men without degrees have the lowest or second-lowest mean in 46 of 54 model-scenario combinations (85.2%). This pattern connects to evidence of growing economic and health vulnerabilities among White men without degrees, highlighting a group whose disadvantages can be obscured by broad racial or gender categories.
This article has been indexed from cs.AI updates on arXiv.org
Read the original article: