Take a Step Back: A Dual-Granularity Raw Feature Empowered Intermediate Fusion Graph Convolutional Network for Multimodal Recommendation
Jinfeng Xu, Zheyu Chen, Shuo Yang, Jinze Li, Wenhao Yuan, Ziyue Peng, Puzhen Wu, Shujie Li, Jian Chen, Zheng Lin, Edith C. H. Ngai
Abstract
Although multimodal recommendations have shown the ability to learn user preferences and item properties by leveraging explicit multimodal information, they remain constrained by two critical limitations: low-quality representation learning and modality fusion. For the former, existing solutions primarily focus on multi-granularity representation learning; however, we argue that training such representations is difficult due to the inherent data sparsity problem in recommendation scenarios. For the latter, existing solutions often rely on contrastive learning to align representations of different modalities to facilitate modality fusion, yet alignment-only objectives may over-compress valuable modality-specific information. To this end, we suggest ``Take a Step Back" and propose a Dual-granularity raw feature empowered Intermediate fusion Graph Convolutional Network (DIGCN) for multimodal recommendation. DIGCN leverages the multimodal understanding capabilities of Large Language Models (LLMs) to construct dual-granularity raw features directly. Furthermore, DIGCN introduces an intermediate fusion graph convolutional network equipped with dynamic cross-modality weight correction, designed to capture cross-modality signals and achieve effective modality fusion. Comprehensive experiments on four real-world datasets validate that DIGCN consistently outperforms a variety of strong baselines. Additional analyses confirm its superiority under varying levels of data sparsity and cold-start scenarios. Notably, DIGCN demonstrates high extensibility, capable of further benefiting from additional contrastive learning-based alignment tasks.
Create a lesson
Related papers
Cost-Aware Agentic Feature Optimization System for Fleet-Scale Ranking Models
Chang Yang, Yao Xuan, Wendan Yan et al.
Democratizing Cross-Project Knowledge for Transforming Water Governance and Climate Resilience: an Agentic AI Ecosystem
Oriol Alàs, Ian Palacín, Iván Cester et al.
From Sessions to Serving: Integrating LLM-Based Embeddings into Retrieval for Production Content Recommendation
Zhixiong Hu, Meng Li, Maggie Zhang et al.
A Task-Level Bias Taxonomy for Historical Image Retrieval
Omkar Gavali, Ratan Sebastian, Christoph Rippe et al.
LINEAGE: A Benchmark for Empirical Lineage Retrieval in AI Scientific Literature
Pangjing Wu, Xu Yuan, Wenqi Fan et al.
CACO: Coverage-Aware Coordinated Optimization for Continuous Generative Retrieval
Pan Zhang, Nan Zhuang, Yongkang Zhang et al.