{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-14366","title":"Representation Alignment for Just Image Transformers is not Easier than You Think","arxiv_id":"2603.14366","date":"2026-03-15","proceeding":null,"authors":["Jaeyo Shin","Jiwook Kim","Hyunjung Shim"],"abstract":"Representation Alignment (REPA) has emerged as a simple way to accelerate Diffusion Transformers training in latent space. At the same time, pixel-space diffusion transformers such as Just image Transformers (JiT) have attracted growing attention because they remove a dependency on a pretrained tokenizer, and then avoid the reconstruction bottleneck of latent diffusion. This paper shows that the REPA can fail for JiT. REPA yields worse FID for JiT as training proceeds and collapses diversity on image subsets that are tightly clustered in the representation space of pretrained semantic encoder on ImageNet. We trace the failure to an information asymmetry: denoising occurs in the high dimensional image space, while the semantic target is strongly compressed, making direct regression a shortcut objective. We propose PixelREPA, which transforms the alignment target and constrains alignment with a Masked Transformer Adapter that combines a shallow transformer adapter with partial token masking. PixelREPA improves both training convergence and final quality. PixelREPA reduces FID from 3.66 to 3.17 for JiT-B$/16$ and improves Inception Score (IS) from 275.1 to 284.6 on ImageNet $256 \\times 256$, while achieving $> 2\\times$ faster convergence. Finally, PixelREPA-H$/16$ achieves FID$=1.81$ and IS$=317.2$. Our code is available at https://github.com/kaist-cvml/PixelREPA.","url_abs":"https://arxiv.org/abs/2603.14366","url_pdf":"https://arxiv.org/pdf/2603.14366","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2603.14366","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.14366"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/kaist-cvml/PixelREPA","reach":null}],"summary":{"ran":6,"ran_draft_wrong":1,"unverified":2},"by_repo_kind":{"found_in_text":{"samples":9,"ran":7,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"6c7d7d14019a14d5","entry":"Attention","repo":"kaist-cvml/PixelREPA","repo_kind":"found_in_text","path":"model_pixelREPA.py","file_url":"https://github.com/kaist-cvml/PixelREPA/blob/HEAD/model_pixelREPA.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6c7d7d14019a14d5"}},{"code_sha256_prefix":"80aa00ff1884e0c9","entry":"BottleneckPatchEmbed","repo":"kaist-cvml/PixelREPA","repo_kind":"found_in_text","path":"model_pixelREPA.py","file_url":"https://github.com/kaist-cvml/PixelREPA/blob/HEAD/model_pixelREPA.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"80aa00ff1884e0c9"}},{"code_sha256_prefix":"85504c53809c9e71","entry":"FinalLayer","repo":"kaist-cvml/PixelREPA","repo_kind":"found_in_text","path":"model_pixelREPA.py","file_url":"https://github.com/kaist-cvml/PixelREPA/blob/HEAD/model_pixelREPA.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"85504c53809c9e71"}},{"code_sha256_prefix":"87930693cba7acab","entry":"LabelEmbedder","repo":"kaist-cvml/PixelREPA","repo_kind":"found_in_text","path":"model_pixelREPA.py","file_url":"https://github.com/kaist-cvml/PixelREPA/blob/HEAD/model_pixelREPA.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"87930693cba7acab"}},{"code_sha256_prefix":"77d34b3ccaee6e17","entry":"RMSNorm","repo":"kaist-cvml/PixelREPA","repo_kind":"found_in_text","path":"model_pixelREPA.py","file_url":"https://github.com/kaist-cvml/PixelREPA/blob/HEAD/model_pixelREPA.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"77d34b3ccaee6e17"}},{"code_sha256_prefix":"38af29b14f134328","entry":"VisionRotaryEmbeddingFast","repo":"kaist-cvml/PixelREPA","repo_kind":"found_in_text","path":"model_pixelREPA.py","file_url":"https://github.com/kaist-cvml/PixelREPA/blob/HEAD/model_pixelREPA.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"38af29b14f134328"}},{"code_sha256_prefix":"ddbfee8e56c96b9c","entry":"scaled_dot_product_attention","repo":"kaist-cvml/PixelREPA","repo_kind":"found_in_text","path":"model_pixelREPA.py","file_url":"https://github.com/kaist-cvml/PixelREPA/blob/HEAD/model_pixelREPA.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ddbfee8e56c96b9c"}},{"code_sha256_prefix":"8c409bbbdd6ab228","entry":"JiT","repo":"kaist-cvml/PixelREPA","repo_kind":"found_in_text","path":"model_pixelREPA.py","file_url":"https://github.com/kaist-cvml/PixelREPA/blob/HEAD/model_pixelREPA.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8c409bbbdd6ab228"}},{"code_sha256_prefix":"52326c48fe513e5f","entry":"JiTBlock","repo":"kaist-cvml/PixelREPA","repo_kind":"found_in_text","path":"model_pixelREPA.py","file_url":"https://github.com/kaist-cvml/PixelREPA/blob/HEAD/model_pixelREPA.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"52326c48fe513e5f"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}