From Sessions to Serving: Integrating LLM-Based Embeddings into Retrieval for Production Content Recommendation
Zhixiong Hu, Meng Li, Maggie Zhang, Deborshi Goswami, David Bailey, James Bradley
Abstract
Personalized content recommendation on large marketplace websites must reconcile heterogeneous candidate content (e.g., customer stories, product pages, industry pages, and learning content) with sparse, fast-changing user behavior, placing increasing demands on the retrieval stage to represent user interest well, not just the downstream ranking stage. We present LSER (LLM Session Embedding Retrieval), a production content recommendation system for autodesk.com that derives session- and history-level embeddings from a pretrained large language model (LLM) and adds them as auxiliary user-side features in the retrieval-stage user tower alongside existing learned sequence encoders. To keep user-side embeddings fresh under real-time behavior, we build a nearline serving path that asynchronously refreshes sequential and LLM-derived user vectors for our main content recommendation server. We validate the incremental value of the LLM features through an ablation study across our full multi-content-type catalog. Our results indicate that integrating LLM-derived embeddings as additional retrieval signals, together with production-grade nearline serving, is technically feasible and can improve model performances.
Create a lesson
Related papers
Cost-Aware Agentic Feature Optimization System for Fleet-Scale Ranking Models
Chang Yang, Yao Xuan, Wendan Yan et al.
Democratizing Cross-Project Knowledge for Transforming Water Governance and Climate Resilience: an Agentic AI Ecosystem
Oriol Alàs, Ian Palacín, Iván Cester et al.
A Task-Level Bias Taxonomy for Historical Image Retrieval
Omkar Gavali, Ratan Sebastian, Christoph Rippe et al.
LINEAGE: A Benchmark for Empirical Lineage Retrieval in AI Scientific Literature
Pangjing Wu, Xu Yuan, Wenqi Fan et al.
CACO: Coverage-Aware Coordinated Optimization for Continuous Generative Retrieval
Pan Zhang, Nan Zhuang, Yongkang Zhang et al.
Can LLMs Resolve Entity Conflicts in Domain Specific NLU Pipelines?
Akansha Bhardwaj, Mingbo Cui, Victor Guimaraes et al.