{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/label-propagation-for-zero-shot","title":"Label Propagation for Zero-shot Classification with Vision-Language Models","arxiv_id":"2404.04072","date":"2024-04-05","proceeding":"CVPR 2024 1","authors":["Vladan Stojnić","Yannis Kalantidis","Giorgos Tolias"],"abstract":"Vision-Language Models (VLMs) have demonstrated impressive performance on zero-shot classification, i.e. classification when provided merely with a list of class names. In this paper, we tackle the case of zero-shot classification in the presence of unlabeled data. We leverage the graph structure of the unlabeled data and introduce ZLaP, a method based on label propagation (LP) that utilizes geodesic distances for classification. We tailor LP to graphs containing both text and image features and further propose an efficient method for performing inductive inference based on a dual solution and a sparsification step. We perform extensive experiments to evaluate the effectiveness of our method on 14 common datasets and show that ZLaP outperforms the latest related works. Code: https://github.com/vladan-stojnic/ZLaP","url_abs":"https://arxiv.org/abs/2404.04072v1","url_pdf":"https://arxiv.org/pdf/2404.04072v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"label-propagation-for-zero-shot","repo_url":"https://github.com/vladan-stojnic/zlap","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"classification-1","task_name":"Classification"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"multi-label-zero-shot-learning","task_name":"Multi-label zero-shot learning"},{"task_slug":"transductive-learning","task_name":"Transductive Learning"},{"task_slug":"transductive-zero-shot-classification","task_name":"Transductive Zero-Shot Classification"},{"task_slug":"zero-shot-learning","task_name":"Zero-Shot Learning"},{"task_slug":null,"task_name":"zero-shot-classification"}],"methods":[{"method_slug":"zlap","method_name":"ZLaP"},{"method_slug":"zlap-1","method_name":"ZLaP*"}],"datasets_introduced":[],"methods_introduced":[{"slug":"zlap","name":"ZLaP","full_name":"Zero-shot label propagation"},{"slug":"zlap-1","name":"ZLaP*","full_name":"Sparsified zero-shot label propagation"}],"results":[{"leaderboard":"/sota/transductive-zero-shot-classification-on-7","task":"Transductive Zero-Shot Classification","dataset":"CIFAR-10","model":"ZLaP","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"93.6"},"uses_additional_data":false},{"leaderboard":"/sota/transductive-zero-shot-classification-on-8","task":"Transductive Zero-Shot Classification","dataset":"CIFAR-100","model":"ZLaP","rank_in_archive_order":1,"of":1,"metrics":{"Accuarcy":"73.3"},"uses_additional_data":false},{"leaderboard":"/sota/transductive-zero-shot-classification-on-cub","task":"Transductive Zero-Shot Classification","dataset":"CUB-200-2011","model":"ZLaP","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"64.1"},"uses_additional_data":false},{"leaderboard":"/sota/transductive-zero-shot-classification-on-6","task":"Transductive Zero-Shot Classification","dataset":"Caltech-101","model":"ZLaP","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"83.7"},"uses_additional_data":false},{"leaderboard":"/sota/transductive-zero-shot-classification-on-dtd","task":"Transductive Zero-Shot Classification","dataset":"DTD","model":"ZLaP","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"51.8"},"uses_additional_data":false},{"leaderboard":"/sota/transductive-zero-shot-classification-on-1","task":"Transductive Zero-Shot Classification","dataset":"EuroSAT","model":"ZLaP","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy":"60.9"},"uses_additional_data":false},{"leaderboard":"/sota/transductive-zero-shot-classification-on-fgvc","task":"Transductive Zero-Shot Classification","dataset":"FGVC-Aircraft","model":"ZLaP","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"28.4"},"uses_additional_data":false},{"leaderboard":"/sota/transductive-zero-shot-classification-on-2","task":"Transductive Zero-Shot Classification","dataset":"Flowers-102","model":"ZLaP","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"73.4"},"uses_additional_data":false},{"leaderboard":"/sota/transductive-zero-shot-classification-on-food","task":"Transductive Zero-Shot Classification","dataset":"Food-101","model":"ZLaP","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"87.9"},"uses_additional_data":false},{"leaderboard":"/sota/transductive-zero-shot-classification-on","task":"Transductive Zero-Shot Classification","dataset":"ImageNet","model":"ZLaP","rank_in_archive_order":1,"of":1,"metrics":{"Top 1 Accuracy":"72.7"},"uses_additional_data":false},{"leaderboard":"/sota/transductive-zero-shot-classification-on-3","task":"Transductive Zero-Shot Classification","dataset":"Oxford-IIIT Pets","model":"ZLaP","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"92.8"},"uses_additional_data":false},{"leaderboard":"/sota/transductive-zero-shot-classification-on-4","task":"Transductive Zero-Shot Classification","dataset":"SUN397","model":"ZLaP","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"71.9"},"uses_additional_data":false},{"leaderboard":"/sota/transductive-zero-shot-classification-on-5","task":"Transductive Zero-Shot Classification","dataset":"Stanford Cars","model":"ZLaP","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"72.1"},"uses_additional_data":false},{"leaderboard":"/sota/transductive-zero-shot-classification-on-9","task":"Transductive Zero-Shot Classification","dataset":"UCF101","model":"ZLaP","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"77.7"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-cifar-10","task":"Zero-Shot Learning","dataset":"CIFAR-10","model":"ZLaP*","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy":"93.6"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-cifar-10","task":"Zero-Shot Learning","dataset":"CIFAR-10","model":"ZLaP","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy":"93.4"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-cifar-100","task":"Zero-Shot Learning","dataset":"CIFAR-100","model":"ZLaP*","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy":"74.2"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-cifar-100","task":"Zero-Shot Learning","dataset":"CIFAR-100","model":"ZLaP","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy":"74"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-cub-200-2011","task":"Zero-Shot Learning","dataset":"CUB-200-2011","model":"ZLaP","rank_in_archive_order":13,"of":14,"metrics":{"Accuracy":"64.3"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-cub-200-2011","task":"Zero-Shot Learning","dataset":"CUB-200-2011","model":"ZLaP*","rank_in_archive_order":14,"of":14,"metrics":{"Accuracy":"64.2"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-caltech-101","task":"Zero-Shot Learning","dataset":"Caltech-101","model":"ZLaP","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy":"84"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-caltech-101","task":"Zero-Shot Learning","dataset":"Caltech-101","model":"ZLaP*","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy":"83.1"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-dtd","task":"Zero-Shot Learning","dataset":"DTD","model":"ZLaP","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy":"51.2"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-dtd","task":"Zero-Shot Learning","dataset":"DTD","model":"ZLaP*","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy":"51"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-eurosat","task":"Zero-Shot Learning","dataset":"EuroSAT","model":"ZLaP*","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"63.2"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-fgvc-aircraft","task":"Zero-Shot Learning","dataset":"FGVC-Aircraft","model":"ZLaP","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy":"29.1"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-fgvc-aircraft","task":"Zero-Shot Learning","dataset":"FGVC-Aircraft","model":"ZLaP*","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy":"29"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-flowers-102","task":"Zero-Shot Learning","dataset":"Flowers-102","model":"ZLaP","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy":"75.9"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-flowers-102","task":"Zero-Shot Learning","dataset":"Flowers-102","model":"ZLaP*","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy":"75.5"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-food-101","task":"Zero-Shot Learning","dataset":"Food-101","model":"ZLaP*","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy":"87.9"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-food-101","task":"Zero-Shot Learning","dataset":"Food-101","model":"ZLaP","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy":"87.8"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-imagenet","task":"Zero-Shot Learning","dataset":"ImageNet","model":"ZLaP","rank_in_archive_order":1,"of":2,"metrics":{"Top 1 Accuracy":"72.1"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-imagenet","task":"Zero-Shot Learning","dataset":"ImageNet","model":"ZLaP*","rank_in_archive_order":2,"of":2,"metrics":{"Top 1 Accuracy":"72.1"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-oxford-iiit-pets","task":"Zero-Shot Learning","dataset":"Oxford-IIIT Pets","model":"ZLaP","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy":"90"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-oxford-iiit-pets","task":"Zero-Shot Learning","dataset":"Oxford-IIIT Pets","model":"ZLaP*","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy":"89"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-sun397","task":"Zero-Shot Learning","dataset":"SUN397","model":"ZLaP*","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy":"71.4"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-sun397","task":"Zero-Shot Learning","dataset":"SUN397","model":"ZLaP","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy":"71"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-stanford-cars","task":"Zero-Shot Learning","dataset":"Stanford Cars","model":"ZLaP*","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy":"71.8"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-stanford-cars","task":"Zero-Shot Learning","dataset":"Stanford Cars","model":"ZLaP","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy":"71.2"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-ucf101","task":"Zero-Shot Learning","dataset":"UCF101","model":"ZLaP","rank_in_archive_order":1,"of":2,"metrics":{"Accuracy":"76.3"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-ucf101","task":"Zero-Shot Learning","dataset":"UCF101","model":"ZLaP*","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy":"76.3"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2404.04072","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.04072"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/vladan-stojnic/ZLaP","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":1,"unverified":1},"by_repo_kind":{"official":{"samples":2,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"6e6c1f2cdab9ec78","entry":"combine_separate_knns","repo":"vladan-stojnic/ZLaP","repo_kind":"official","path":"zlap.py","file_url":"https://github.com/vladan-stojnic/ZLaP/blob/HEAD/zlap.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6e6c1f2cdab9ec78"}},{"code_sha256_prefix":"7075d41a55223ea5","entry":"search_faiss","repo":"vladan-stojnic/ZLaP","repo_kind":"official","path":"utils.py","file_url":"https://github.com/vladan-stojnic/ZLaP/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7075d41a55223ea5"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}