Multi-Prompt Style Interpolation for Fine-Grained Artistic Control

Abstract

Text-driven image style transfer has seen remarkable progress with methods leveraging cross-modal embeddings for fast, high-quality stylization. However, most existing pipelines assume a single textual style prompt, limiting the range of artistic control and expressiveness. In this paper, we propose a novel multi-prompt style interpolation framework that extends the recently introduced StyleMamba approach. Our method supports blending or interpolating among multiple textual prompts (eg, ``cubism,'' ``impressionism,'' and ``cartoon''), allowing the creation of nuanced or hybrid artistic styles within a single image. We introduce a Multi-Prompt Embedding Mixer combined with Adaptive Blending Weights to enable fine-grained control over the spatial and semantic influence of each style. Further, we propose a Hierarchical Masked Directional Loss to refine region-specific style consistency. Experiments and user studies confirm our approach outperforms single-prompt baselines and naive linear combinations of styles, achieving superior style fidelity, text-image alignment, and artistic flexibility, all while maintaining the computational efficiency offered by the state-space formulation.

0

Turn this paper into a full lesson

ArcXiv compiles a staged curriculum from this paper: 8-12 lessons across beginner → advanced, synthesised section guides, visuals, flashcards, a quiz, exercises, and on-demand deep dives per section. Grounded in the abstract, never invented.

Discussion (0)

Sign in to join the discussion.

Loading comments…