{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2601-17950","title":"UPLiFT: Efficient Pixel-Dense Feature Upsampling with Local Attenders","arxiv_id":"2601.17950","date":"2026-01-25","proceeding":null,"authors":["Matthew Walmer","Saksham Suri","Anirud Aggarwal","Abhinav Shrivastava"],"abstract":"The space of task-agnostic feature upsampling has emerged as a promising area of research to efficiently create denser features from pre-trained visual backbones. These methods act as a shortcut to achieve dense features for a fraction of the cost by learning to map low-resolution features to high-resolution versions. While early works in this space used iterative upsampling approaches, more recent works have switched to cross-attention-based methods, which risk falling into the same efficiency scaling problems of the backbones they are upsampling. In this work, we demonstrate that iterative upsampling methods can still compete with cross-attention-based methods; moreover, they can achieve state-of-the-art performance with lower inference costs. We propose UPLiFT, an architecture for Universal Pixel-dense Lightweight Feature Transforms. We also propose an efficient Local Attender operator to overcome the limitations of prior iterative feature upsampling methods. This operator uses an alternative attentional pooling formulation defined fully locally. We show that our Local Attender allows UPLiFT to maintain stable features throughout upsampling, enabling state-of-the-art performance with lower inference costs than existing pixel-dense feature upsamplers. In addition, we apply UPLiFT to generative downstream tasks and show that it achieves competitive performance with state-of-the-art Coupled Flow Matching models for VAE feature upsampling. Altogether, UPLiFT offers a versatile and efficient approach to creating denser features.","url_abs":"https://arxiv.org/abs/2601.17950","url_pdf":"https://arxiv.org/pdf/2601.17950","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2601.17950","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2601.17950"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/mwalmer-umd/UPLiFT","reach":null}],"summary":{"unverified":9},"by_repo_kind":{"found_in_text":{"samples":9,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"837cef52d8dc90de","entry":"bytes_to_giga_bytes","repo":"mwalmer-umd/UPLiFT","repo_kind":"found_in_text","path":"uplift/extractors/diff_extractor.py","file_url":"https://github.com/mwalmer-umd/UPLiFT/blob/HEAD/uplift/extractors/diff_extractor.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"837cef52d8dc90de"}},{"code_sha256_prefix":"a0d083b3c608613d","entry":"get_dataroot","repo":"mwalmer-umd/UPLiFT","repo_kind":"found_in_text","path":"uplift/datasets/datasets_helper.py","file_url":"https://github.com/mwalmer-umd/UPLiFT/blob/HEAD/uplift/datasets/datasets_helper.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a0d083b3c608613d"}},{"code_sha256_prefix":"89463dafd980747c","entry":"get_patch_size_channels","repo":"mwalmer-umd/UPLiFT","repo_kind":"found_in_text","path":"uplift/extractors/vit_wrapper.py","file_url":"https://github.com/mwalmer-umd/UPLiFT/blob/HEAD/uplift/extractors/vit_wrapper.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"89463dafd980747c"}},{"code_sha256_prefix":"80db0b2e7f2f1d55","entry":"load_model","repo":"mwalmer-umd/UPLiFT","repo_kind":"found_in_text","path":"uplift/hub_loader.py","file_url":"https://github.com/mwalmer-umd/UPLiFT/blob/HEAD/uplift/hub_loader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"80db0b2e7f2f1d55"}},{"code_sha256_prefix":"de4efef6cf8288cd","entry":"make_fast","repo":"mwalmer-umd/UPLiFT","repo_kind":"found_in_text","path":"uplift/fast.py","file_url":"https://github.com/mwalmer-umd/UPLiFT/blob/HEAD/uplift/fast.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"de4efef6cf8288cd"}},{"code_sha256_prefix":"0d795ce6c175c917","entry":"noise_and_combine","repo":"mwalmer-umd/UPLiFT","repo_kind":"found_in_text","path":"uplift/uplift.py","file_url":"https://github.com/mwalmer-umd/UPLiFT/blob/HEAD/uplift/uplift.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0d795ce6c175c917"}},{"code_sha256_prefix":"7a9123b529f6ec95","entry":"residual_auto","repo":"mwalmer-umd/UPLiFT","repo_kind":"found_in_text","path":"uplift/uplift.py","file_url":"https://github.com/mwalmer-umd/UPLiFT/blob/HEAD/uplift/uplift.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7a9123b529f6ec95"}},{"code_sha256_prefix":"00d79ce304570691","entry":"resize_sf","repo":"mwalmer-umd/UPLiFT","repo_kind":"found_in_text","path":"uplift/uplift.py","file_url":"https://github.com/mwalmer-umd/UPLiFT/blob/HEAD/uplift/uplift.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"00d79ce304570691"}},{"code_sha256_prefix":"b339c0edb12b3f1f","entry":"retrieve_latents","repo":"mwalmer-umd/UPLiFT","repo_kind":"found_in_text","path":"uplift/extractors/diff_extractor.py","file_url":"https://github.com/mwalmer-umd/UPLiFT/blob/HEAD/uplift/extractors/diff_extractor.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b339c0edb12b3f1f"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CV","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}