論文 / arXiv:2611.08487
User Embeddings are Superpositions of Interpretable Behavioral Modes
PLAIN SUMMARY / やさしい要約
推薦サービスは、ユーザを数値のかたまり(埋め込み)で表して判断することがありますが、その中身は人には分かりにくいままです。この研究は、その数値のかたまりを「いくつかの分かりやすい行動パターンの足し合わせ」として読み解ける可能性を示します。さらに、見つけた行動パターンに言葉で名前を付け、言葉で探せるとしています。たとえるなら、混ざった音(埋め込み)から、いくつかの楽器の音色(行動モード)を取り出して、名前を付けて呼び出すような発想です。
AIが専門用語を使わずに書いた解説です。内容の正確さは、下の原文の要旨で確認してください。
ABSTRACT / 要旨(原文)
User embeddings are central components of modern recommendation, personalization, and behavioral modeling systems. Though these embeddings can compactly encode rich behavioral information, they are inherently dense and opaque, limiting interpretability. To address this gap, we argue that user embeddings can be understood as sparse superpositions of interpretable behavioral modes. This structure is directly predicted by generative models of user behavior for linear embeddings and extends approximately to deep-learning representations by the superposition hypothesis. Superimposed modes can naturally be recovered by sparse dictionary learning methods, such as sparse autoencoders (SAEs), and recovered modes can be automatically named and queried in natural language. We validate mode recovery against known ground truth on synthetic data, where SAEs recover modes better than classical sparse baselines, including on transformer-encoded embeddings. We then apply the method to classical and transformer-based user embeddings from two real-world datasets. We also show how the corresponding natural-language labels enable zero-shot audience retrieval and characterization over embeddings never trained on text. The framework is post-hoc and model-agnostic, requiring no modification to the upstream embedding system.
ここに表示しているのは原論文の要旨です。AIによる要約や解釈は含みません。
