Papers › Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling

Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling

29 Jan 2025arXiv:2501.17811archive 2025-07-28

Xiaokang Chen, Zhiyu Wu, Xingchao Liu, Zizheng Pan, Wen Liu, Zhenda Xie, Xingkai Yu, Chong Ruan

In this work, we introduce Janus-Pro, an advanced version of the previous work Janus. Specifically, Janus-Pro incorporates (1) an optimized training strategy, (2) expanded training data, and (3) scaling to larger model size. With these improvements, Janus-Pro achieves significant advancements in both multimodal understanding and text-to-image instruction-following capabilities, while also enhancing the stability of text-to-image generation. We hope this work will inspire further exploration in the field. Code and models are publicly available.

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

deepseek-ai/janus officialmentioned in paperpytorchMIT report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image GenerationInstruction FollowingText to Image GenerationText-to-Image GenerationVisual Question Answering

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
WISE Janus-Pro-7B Biology 0.36 #10 of 11 Archive leaderboard report
WISE Janus-Pro-7B Chemistry 0.26 #10 of 11 Archive leaderboard report
WISE Janus-Pro-7B Cultural 0.30 #10 of 11 Archive leaderboard report
WISE Janus-Pro-7B Overall 0.35 #10 of 11 Archive leaderboard report
WISE Janus-Pro-7B Physics 0.42 #10 of 11 Archive leaderboard report
WISE Janus-Pro-7B Space 0.49 #10 of 11 Archive leaderboard report
WISE Janus-Pro-7B Time 0.37 #10 of 11 Archive leaderboard report
Image Generation WISE Janus-pro Biology 0.36 #12 of 14 Archive leaderboard report
Image Generation WISE Janus-pro Chemistry 0.26 #12 of 14 Archive leaderboard report
Image Generation WISE Janus-pro Cultural 0.30 #12 of 14 Archive leaderboard report
Image Generation WISE Janus-pro Overall 0.35 #12 of 14 Archive leaderboard report
Image Generation WISE Janus-pro Physics 0.42 #12 of 14 Archive leaderboard report
Image Generation WISE Janus-pro Space 0.49 #12 of 14 Archive leaderboard report
Image Generation WISE Janus-pro Time 0.37 #12 of 14 Archive leaderboard report
Image Generation WISE Janus Biology 0.28 #14 of 14 Archive leaderboard report
Image Generation WISE Janus Chemistry 0.14 #14 of 14 Archive leaderboard report
Image Generation WISE Janus Cultural 0.16 #14 of 14 Archive leaderboard report
Image Generation WISE Janus Overall 0.23 #14 of 14 Archive leaderboard report
Image Generation WISE Janus Physics 0.30 #14 of 14 Archive leaderboard report
Image Generation WISE Janus Space 0.35 #14 of 14 Archive leaderboard report
Image Generation WISE Janus Time 0.26 #14 of 14 Archive leaderboard report
Text-to-Image Generation GenEval Janus-Pro-7B Overall 0.80 #6 of 20 Archive leaderboard report
Text-to-Image Generation GenEval Janus-Pro-1B Overall 0.73 #10 of 20 Archive leaderboard report
Visual Question Answering MM-Vet Janus-Pro-7B GPT-4 score 50.0 #65 of 231 Archive leaderboard report
Visual Question Answering MM-Vet Janus-Pro-1B GPT-4 score 39.8 #116 of 231 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections