Regularizing Treatment Leakage for LLM-based Uplift Estimation

arXiv:2611.20794v1 Announce Type: new
Abstract: Uplift modeling estimates the conditional average treatment effect (CATE) and supports industrial decisions such as promotional pricing. When large language models (LLMs) encode product text, treatment-revealing content can introduce shortcuts that do not transfer to deployment. We propose \emph{LLM-based Uplift Leakage Regularization} (\textsc{LULR}), which uses a CLUB-based penalty on the causal head's trainable shared representation while keeping the LLM encoder frozen. Controlled proxy experiments show a positive ranking-score interaction and higher scores than the tested weight-decay configuration; treatment-dependent evaluation limits their interpretation to exploratory model behavior. Structured-only comparisons provide reference performance, without establishing a general advantage over tree-based estimators. On a million-record industrial pricing RCT, \textsc{LULR} improves offline $\text{lift@}0.3$ in $4/5$ seeds, although the difference is not statistically significant and estimated policy values are near-tied. A separate one-week online A/B experiment records $5.45\%$ higher sales volume and $1.91\%$ higher GMV than the control arm. These aggregate results provide short-term business evidence for the complete deployed pricing policy; they do not isolate the regularizer's contribution.
This article has been indexed from cs.AI updates on arXiv.org

Read the original article:

Regularizing Treatment Leakage for LLM-based Uplift Estimation