{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/qekd-query-efficient-and-data-free-knowledge","title":"IDEAL: Query-Efficient Data-Free Learning from Black-box Models","arxiv_id":"2205.11158","date":"2022-05-23","proceeding":null,"authors":["Jie Zhang","Chen Chen","Lingjuan Lyu"],"abstract":"Knowledge Distillation (KD) is a typical method for training a lightweight student model with the help of a well-trained teacher model. However, most KD methods require access to either the teacher's training data or model parameters, which is unrealistic. To tackle this problem, recent works study KD under data-free and black-box settings. Nevertheless, these works require a large number of queries to the teacher model, which incurs significant monetary and computational costs. To address these problems, we propose a novel method called \\emph{query-effIcient Data-free lEarning from blAck-box modeLs} (IDEAL), which aims to query-efficiently learn from black-box model APIs to train a good student without any real data. In detail, IDEAL trains the student model in two stages: data generation and model distillation. Note that IDEAL does not require any query in the data generation stage and queries the teacher only once for each sample in the distillation stage. Extensive experiments on various real-world datasets show the effectiveness of the proposed IDEAL. For instance, IDEAL can improve the performance of the best baseline method DFME by 5.83% on CIFAR10 dataset with only 0.02x the query budget of DFME.","url_abs":"https://arxiv.org/abs/2205.11158v2","url_pdf":"https://arxiv.org/pdf/2205.11158v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"qekd-query-efficient-and-data-free-knowledge","repo_url":"https://github.com/SonyResearch/IDEAL","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"knowledge-distillation","task_name":"Knowledge Distillation"}],"methods":[{"method_slug":"knowledge-distillation","method_name":"Knowledge Distillation"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2205.11158","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2205.11158"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/SonyResearch/IDEAL","reach":null}],"summary":{"ran":4,"ran_honours":1,"ran_fixture":1,"unverified":3},"by_repo_kind":{"official":{"samples":9,"ran":6,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":9,"samples":[{"code_sha256_prefix":"abc9eaa5b451fe30","entry":"ImagePool","repo":"SonyResearch/IDEAL","repo_kind":"official","path":"ideal.py","file_url":"https://github.com/SonyResearch/IDEAL/blob/HEAD/ideal.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"abc9eaa5b451fe30"}},{"code_sha256_prefix":"fea8593595e2f27e","entry":"MultiTransform","repo":"SonyResearch/IDEAL","repo_kind":"official","path":"ideal.py","file_url":"https://github.com/SonyResearch/IDEAL/blob/HEAD/ideal.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"fea8593595e2f27e"}},{"code_sha256_prefix":"002435048d902c2b","entry":"ScoreLoss","repo":"SonyResearch/IDEAL","repo_kind":"official","path":"ideal.py","file_url":"https://github.com/SonyResearch/IDEAL/blob/HEAD/ideal.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"002435048d902c2b"}},{"code_sha256_prefix":"5f21c2a0326255ba","entry":"UnlabeledImageDataset","repo":"SonyResearch/IDEAL","repo_kind":"official","path":"ideal.py","file_url":"https://github.com/SonyResearch/IDEAL/blob/HEAD/ideal.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5f21c2a0326255ba"}},{"code_sha256_prefix":"6e9ea8d136c8ef1c","entry":"_collect_all_images","repo":"SonyResearch/IDEAL","repo_kind":"official","path":"ideal.py","file_url":"https://github.com/SonyResearch/IDEAL/blob/HEAD/ideal.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6e9ea8d136c8ef1c"}},{"code_sha256_prefix":"5b0b8943792955d3","entry":"pack_images","repo":"SonyResearch/IDEAL","repo_kind":"official","path":"ideal.py","file_url":"https://github.com/SonyResearch/IDEAL/blob/HEAD/ideal.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5b0b8943792955d3"}},{"code_sha256_prefix":"61fe0765e1db67f8","entry":"Synthesizer","repo":"SonyResearch/IDEAL","repo_kind":"official","path":"ideal.py","file_url":"https://github.com/SonyResearch/IDEAL/blob/HEAD/ideal.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"61fe0765e1db67f8"}},{"code_sha256_prefix":"e16e5798fac8f2b0","entry":"reset_model","repo":"SonyResearch/IDEAL","repo_kind":"official","path":"ideal.py","file_url":"https://github.com/SonyResearch/IDEAL/blob/HEAD/ideal.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e16e5798fac8f2b0"}},{"code_sha256_prefix":"a6f98dae5dedc142","entry":"save_image_batch","repo":"SonyResearch/IDEAL","repo_kind":"official","path":"ideal.py","file_url":"https://github.com/SonyResearch/IDEAL/blob/HEAD/ideal.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a6f98dae5dedc142"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}