Papers › Sem-CS: Semantic CLIPStyler for Text-Based Image Style Transfer

Sem-CS: Semantic CLIPStyler for Text-Based Image Style Transfer

12 Jul 2023arXiv:2307.05934archive 2025-07-28

Chanda Grover Kamra, Indra Deep Mastan, Debayan Gupta

CLIPStyler demonstrated image style transfer with realistic textures using only a style text description (instead of requiring a reference style image). However, the ground semantics of objects in the style transfer output is lost due to style spill-over on salient and background objects (content mismatch) or over-stylization. To solve this, we propose Semantic CLIPStyler (Sem-CS), that performs semantic style transfer. Sem-CS first segments the content image into salient and non-salient objects and then transfers artistic style based on a given style text description. The semantic style transfer is achieved using global foreground loss (for salient objects) and global background loss (for non-salient objects). Our empirical results, including DISTS, NIMA and user study scores, show that our proposed framework yields superior qualitative and quantitative performance. Our code is available at github.com/chandagrover/sem-cs.

PaperPDFCode

Code

chandagrover/sem-cs officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Style Transfer

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

NIMA

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections