{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/task/knowledge-distillation/papers/2","list_of":"/task/knowledge-distillation","task":"Knowledge Distillation","archive":{"snapshot":"2025-07-28"},"key_notes":{"n_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","n_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"syntology_read_at":"2026-09-28T10:30:06+00:00","order":"archive","order_definition":"repositories listed in the archive (most first), then date (newest first), then slug","page":2,"pages_in_order":43,"rows_per_page":100,"rows":[101,200],"of":4240,"counts":{"archive_papers_tagged":4240,"with_a_code_link":1740,"where_syntology_ran_a_sample":451,"not_listed_spam_title":0,"listed":4240,"listed_where_code_ran":451,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":380,"every_run_a_failure_of_syntologys_instrument":71,"listed_with_a_run_with_no_instrument_failure":380,"listed_every_run_a_failure_of_syntologys_instrument":71,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"first_page":"/task/knowledge-distillation","prev":"/task/knowledge-distillation","next":"/task/knowledge-distillation/papers/3","papers":[{"url":"/paper/localized-symbolic-knowledge-distillation-for-1","slug":"localized-symbolic-knowledge-distillation-for-1","title":"Localized Symbolic Knowledge Distillation for Visual Commonsense Models","date":"2023-12-08","arxiv_id":"2312.04837","repositories_listed":2,"syntology":{"n":10,"n_ran":8,"n_constructed":0,"n_ran_checked":6,"n_instrument":2,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":1,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/localized-symbolic-knowledge-distillation-for-1#ran","syntology_url":"https://syntology.ai/paper/2312.04837","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.04837"}},"official":{"repos":["jamespark3922/localized-skd","jamespark3922/lskd"],"state":"official (archive's flag): 8 ran","n_ran":8,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":2,"ran_from_kinds":["official"]}}},{"url":"/paper/distil-whisper-robust-knowledge-distillation","slug":"distil-whisper-robust-knowledge-distillation","title":"Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labelling","date":"2023-11-01","arxiv_id":"2311.00430","repositories_listed":2,"syntology":{"n":4,"n_ran":3,"n_constructed":0,"n_ran_checked":1,"n_instrument":2,"n_unverified":1,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/distil-whisper-robust-knowledge-distillation#ran","syntology_url":"https://syntology.ai/paper/2311.00430","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.00430"}},"official":{"repos":["huggingface/distil-whisper"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/dad-improved-data-free-test-time-adversarial","slug":"dad-improved-data-free-test-time-adversarial","title":"DAD++: Improved Data-free Test Time Adversarial Defense","date":"2023-09-10","arxiv_id":"2309.05132","repositories_listed":2,"syntology":null},{"url":"/paper/synthdistill-face-recognition-with-knowledge","slug":"synthdistill-face-recognition-with-knowledge","title":"SynthDistill: Face Recognition with Knowledge Distillation from Synthetic Data","date":"2023-08-28","arxiv_id":"2308.14852","repositories_listed":2,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/synthdistill-face-recognition-with-knowledge#ran","syntology_url":"https://syntology.ai/paper/2308.14852","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.14852"}},"official":{"repos":["otroshi/synthdistill","gitlab.idiap.ch/bob/bob.paper.ijcb2023_synthdistill"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/fedsol-bridging-global-alignment-and-local","slug":"fedsol-bridging-global-alignment-and-local","title":"FedSOL: Stabilized Orthogonal Learning with Proximal Restrictions in Federated Learning","date":"2023-08-24","arxiv_id":"2308.12532","repositories_listed":2,"syntology":{"n":11,"n_ran":10,"n_constructed":0,"n_ran_checked":9,"n_instrument":1,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":9,"n_pointer_only":1,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/fedsol-bridging-global-alignment-and-local#ran","syntology_url":"https://syntology.ai/paper/2308.12532","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.12532"}},"official":{"repos":["Lee-Gihun/FedSOL"],"state":"official (archive's flag): 10 ran","n_ran":10,"n_constructed":0,"n_ran_no_instrument_failure":9,"n_unverified":1,"ran_from_kinds":["official"]}}},{"url":"/paper/sentence-embedding-models-for-ancient-greek","slug":"sentence-embedding-models-for-ancient-greek","title":"Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge Distillation","date":"2023-08-24","arxiv_id":"2308.13116","repositories_listed":2,"syntology":null},{"url":"/paper/aicsd-adaptive-inter-class-similarity","slug":"aicsd-adaptive-inter-class-similarity","title":"AICSD: Adaptive Inter-Class Similarity Distillation for Semantic Segmentation","date":"2023-08-08","arxiv_id":"2308.04243","repositories_listed":2,"syntology":null},{"url":"/paper/fitting-auditory-filterbanks-with","slug":"fitting-auditory-filterbanks-with","title":"Fitting Auditory Filterbanks with Multiresolution Neural Networks","date":"2023-07-25","arxiv_id":"2307.13821","repositories_listed":2,"syntology":null},{"url":"/paper/class-relation-knowledge-distillation-for","slug":"class-relation-knowledge-distillation-for","title":"Class-relation Knowledge Distillation for Novel Class Discovery","date":"2023-07-18","arxiv_id":"2307.09158","repositories_listed":2,"syntology":{"n":3,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":1,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/class-relation-knowledge-distillation-for#ran","syntology_url":"https://syntology.ai/paper/2307.09158","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.09158"}},"official":{"repos":["kleinzcy/cr-kd-ncd"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":["listed"]}}},{"url":"/paper/learning-to-retrieve-in-context-examples-for","slug":"learning-to-retrieve-in-context-examples-for","title":"Learning to Retrieve In-Context Examples for Large Language Models","date":"2023-07-14","arxiv_id":"2307.07164","repositories_listed":2,"syntology":null},{"url":"/paper/mdvit-multi-domain-vision-transformer-for","slug":"mdvit-multi-domain-vision-transformer-for","title":"MDViT: Multi-domain Vision Transformer for Small Medical Image Segmentation Datasets","date":"2023-07-05","arxiv_id":"2307.02100","repositories_listed":2,"syntology":null},{"url":"/paper/variation-aware-vision-transformer","slug":"variation-aware-vision-transformer","title":"Quantization Variation: A New Perspective on Training Transformers with Low-Bit Precision","date":"2023-07-01","arxiv_id":"2307.00331","repositories_listed":2,"syntology":null},{"url":"/paper/knowledge-distillation-of-large-language","slug":"knowledge-distillation-of-large-language","title":"MiniLLM: Knowledge Distillation of Large Language Models","date":"2023-06-14","arxiv_id":"2306.08543","repositories_listed":2,"syntology":null},{"url":"/paper/self-supervised-audio-teacher-student","slug":"self-supervised-audio-teacher-student","title":"Self-supervised Audio Teacher-Student Transformer for Both Clip-level and Frame-level Tasks","date":"2023-06-07","arxiv_id":"2306.04186","repositories_listed":2,"syntology":null},{"url":"/paper/i-3-retriever-incorporating-implicit","slug":"i-3-retriever-incorporating-implicit","title":"I^3 Retriever: Incorporating Implicit Interaction in Pre-trained Language Models for Passage Retrieval","date":"2023-06-04","arxiv_id":"2306.02371","repositories_listed":2,"syntology":{"n":10,"n_ran":5,"n_constructed":0,"n_ran_checked":5,"n_instrument":0,"n_unverified":5,"n_honours":0,"n_violates":0,"n_no_contract":5,"n_pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified","sample_list":"/paper/i-3-retriever-incorporating-implicit#ran","syntology_url":"https://syntology.ai/paper/2306.02371","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.02371"}},"official":{"repos":["deriq-qian-dong/iii-retriever"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/disco-distilled-student-models-co-training","slug":"disco-distilled-student-models-co-training","title":"DisCo: Distilled Student Models Co-training for Semi-supervised Text Mining","date":"2023-05-20","arxiv_id":"2305.12074","repositories_listed":2,"syntology":{"n":17,"n_ran":5,"n_constructed":1,"n_ran_checked":5,"n_instrument":0,"n_unverified":12,"n_honours":0,"n_violates":0,"n_no_contract":5,"n_pointer_only":17,"phrase":"5 ran (of which 1 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 12 unverified","sample_list":"/paper/disco-distilled-student-models-co-training#ran","syntology_url":"https://syntology.ai/paper/2305.12074","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.12074"}},"official":{"repos":["litesslhub/disco"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":11,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/bevsimdet-simulated-multi-modal-distillation","slug":"bevsimdet-simulated-multi-modal-distillation","title":"SimDistill: Simulated Multi-modal Distillation for BEV 3D Object Detection","date":"2023-03-29","arxiv_id":"2303.16818","repositories_listed":2,"syntology":{"n":10,"n_ran":10,"n_constructed":0,"n_ran_checked":10,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":10,"n_pointer_only":3,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/bevsimdet-simulated-multi-modal-distillation#ran","syntology_url":"https://syntology.ai/paper/2303.16818","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.16818"}},"official":{"repos":["vitae-transformer/bevsimdet","vitae-transformer/simdistill"],"state":"official (archive's flag): 10 ran","n_ran":10,"n_constructed":0,"n_ran_no_instrument_failure":10,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/improving-neural-topic-models-with","slug":"improving-neural-topic-models-with","title":"Improving Neural Topic Models with Wasserstein Knowledge Distillation","date":"2023-03-27","arxiv_id":"2303.15350","repositories_listed":2,"syntology":null},{"url":"/paper/social4rec-distilling-user-preference-from","slug":"social4rec-distilling-user-preference-from","title":"Social4Rec: Distilling User Preference from Social Graph for Video Recommendation in Tencent","date":"2023-02-20","arxiv_id":"2302.09971","repositories_listed":2,"syntology":null},{"url":"/paper/multi-teacher-knowledge-distillation-as-an","slug":"multi-teacher-knowledge-distillation-as-an","title":"Multi-teacher knowledge distillation as an effective method for compressing ensembles of neural networks","date":"2023-02-14","arxiv_id":"2302.07215","repositories_listed":2,"syntology":null},{"url":"/paper/jaccard-metric-losses-optimizing-the-jaccard-1","slug":"jaccard-metric-losses-optimizing-the-jaccard-1","title":"Jaccard Metric Losses: Optimizing the Jaccard Index with Soft Labels","date":"2023-02-11","arxiv_id":"2302.05666","repositories_listed":2,"syntology":{"n":1,"n_ran":1,"n_constructed":1,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":1,"phrase":"1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result","sample_list":"/paper/jaccard-metric-losses-optimizing-the-jaccard-1#ran","syntology_url":"https://syntology.ai/paper/2302.05666","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2302.05666"}},"official":{"repos":["zifuwanggg/jdtlosses"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/knowledge-transfer-from-pre-trained-language","slug":"knowledge-transfer-from-pre-trained-language","title":"Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation","date":"2023-01-30","arxiv_id":"2301.13003","repositories_listed":2,"syntology":null},{"url":"/paper/remembering-normality-memory-guided-knowledge","slug":"remembering-normality-memory-guided-knowledge","title":"Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection","date":"2023-01-01","arxiv_id":null,"repositories_listed":2,"syntology":null},{"url":"/paper/fedukd-federated-unet-model-with-knowledge","slug":"fedukd-federated-unet-model-with-knowledge","title":"FedUKD: Federated UNet Model with Knowledge Distillation for Land Use Classification from Satellite and Street Views","date":"2022-12-05","arxiv_id":"2212.02196","repositories_listed":2,"syntology":null},{"url":"/paper/knowledge-distillation-for-detection","slug":"knowledge-distillation-for-detection","title":"Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling","date":"2022-11-15","arxiv_id":"2211.08071","repositories_listed":2,"syntology":null},{"url":"/paper/cabvit-cross-attention-among-blocks-for","slug":"cabvit-cross-attention-among-blocks-for","title":"Fcaformer: Forward Cross Attention in Hybrid Vision Transformer","date":"2022-11-14","arxiv_id":"2211.07198","repositories_listed":2,"syntology":null},{"url":"/paper/efficient-large-scale-audio-tagging-via","slug":"efficient-large-scale-audio-tagging-via","title":"Efficient Large-scale Audio Tagging via Transformer-to-CNN Knowledge Distillation","date":"2022-11-09","arxiv_id":"2211.04772","repositories_listed":2,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":1,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":1,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/efficient-large-scale-audio-tagging-via#ran","syntology_url":"https://syntology.ai/paper/2211.04772","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2211.04772"}},"official":{"repos":["fschmid56/efficientat"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/quala-minilm-a-quantized-length-adaptive","slug":"quala-minilm-a-quantized-length-adaptive","title":"QuaLA-MiniLM: a Quantized Length Adaptive MiniLM","date":"2022-10-31","arxiv_id":"2210.17114","repositories_listed":2,"syntology":null},{"url":"/paper/geometric-knowledge-distillation-topology","slug":"geometric-knowledge-distillation-topology","title":"Geometric Knowledge Distillation: Topology Compression for Graph Neural Networks","date":"2022-10-24","arxiv_id":"2210.13014","repositories_listed":2,"syntology":{"n":2,"n_ran":1,"n_constructed":1,"n_ran_checked":1,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":2,"phrase":"1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result","sample_list":"/paper/geometric-knowledge-distillation-topology#ran","syntology_url":"https://syntology.ai/paper/2210.13014","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.13014"}},"official":{"repos":["chr26195/gkd"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/let-images-give-you-more-point-cloud-cross","slug":"let-images-give-you-more-point-cloud-cross","title":"Let Images Give You More:Point Cloud Cross-Modal Training for Shape Analysis","date":"2022-10-09","arxiv_id":"2210.04208","repositories_listed":2,"syntology":null},{"url":"/paper/on-device-domain-generalization","slug":"on-device-domain-generalization","title":"On-Device Domain Generalization","date":"2022-09-15","arxiv_id":"2209.07521","repositories_listed":2,"syntology":null},{"url":"/paper/chinese-grammatical-error-correction-based-on-1","slug":"chinese-grammatical-error-correction-based-on-1","title":"Chinese grammatical error correction based on knowledge distillation","date":"2022-07-31","arxiv_id":"2208.00351","repositories_listed":2,"syntology":null},{"url":"/paper/online-knowledge-distillation-via-mutual","slug":"online-knowledge-distillation-via-mutual","title":"Online Knowledge Distillation via Mutual Contrastive Learning for Visual Recognition","date":"2022-07-23","arxiv_id":"2207.11518","repositories_listed":2,"syntology":null},{"url":"/paper/multi-level-branched-regularization-for","slug":"multi-level-branched-regularization-for","title":"Multi-Level Branched Regularization for Federated Learning","date":"2022-07-14","arxiv_id":"2207.06936","repositories_listed":2,"syntology":{"n":2,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/multi-level-branched-regularization-for#ran","syntology_url":"https://syntology.ai/paper/2207.06936","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2207.06936"}},"official":{"repos":["jinkyu032/FedMLB"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":["official"]}}},{"url":"/paper/knowledge-condensation-distillation","slug":"knowledge-condensation-distillation","title":"Knowledge Condensation Distillation","date":"2022-07-12","arxiv_id":"2207.05409","repositories_listed":2,"syntology":{"n":1,"n_ran":1,"n_constructed":1,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":1,"phrase":"1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result","sample_list":"/paper/knowledge-condensation-distillation#ran","syntology_url":"https://syntology.ai/paper/2207.05409","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2207.05409"}},"official":{"repos":["dzy3/kcd"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/metafed-federated-learning-among-federations","slug":"metafed-federated-learning-among-federations","title":"MetaFed: Federated Learning among Federations with Cyclic Knowledge Distillation for Personalized Healthcare","date":"2022-06-17","arxiv_id":"2206.08516","repositories_listed":2,"syntology":null},{"url":"/paper/optimizing-performance-of-federated-person-re","slug":"optimizing-performance-of-federated-person-re","title":"Optimizing Performance of Federated Person Re-identification: Benchmarking and Analysis","date":"2022-05-24","arxiv_id":"2205.12144","repositories_listed":2,"syntology":{"n":8,"n_ran":6,"n_constructed":0,"n_ran_checked":6,"n_instrument":0,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":0,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/optimizing-performance-of-federated-person-re#ran","syntology_url":"https://syntology.ai/paper/2205.12144","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2205.12144"}},"official":{"repos":["cap-ntu/FedReID","EasyFL-AI/EasyFL"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":2,"ran_from_kinds":["official"]}}},{"url":"/paper/knowledge-distillation-via-the-target-aware","slug":"knowledge-distillation-via-the-target-aware","title":"Knowledge Distillation via the Target-aware Transformer","date":"2022-05-22","arxiv_id":"2205.10793","repositories_listed":2,"syntology":{"n":2,"n_ran":2,"n_constructed":2,"n_ran_checked":2,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":0,"phrase":"2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result","sample_list":"/paper/knowledge-distillation-via-the-target-aware#ran","syntology_url":"https://syntology.ai/paper/2205.10793","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2205.10793"}},"official":{"repos":["sihaoevery/tat"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/spot-adaptive-knowledge-distillation","slug":"spot-adaptive-knowledge-distillation","title":"Spot-adaptive Knowledge Distillation","date":"2022-05-05","arxiv_id":"2205.02399","repositories_listed":2,"syntology":null},{"url":"/paper/solving-imagenet-a-unified-scheme-for","slug":"solving-imagenet-a-unified-scheme-for","title":"Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results","date":"2022-04-07","arxiv_id":"2204.03475","repositories_listed":2,"syntology":null},{"url":"/paper/distill-vq-learning-retrieval-oriented-vector","slug":"distill-vq-learning-retrieval-oriented-vector","title":"Distill-VQ: Learning Retrieval Oriented Vector Quantization By Distilling Knowledge from Dense Embeddings","date":"2022-04-01","arxiv_id":"2204.00185","repositories_listed":2,"syntology":{"n":8,"n_ran":6,"n_constructed":0,"n_ran_checked":6,"n_instrument":0,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":0,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/distill-vq-learning-retrieval-oriented-vector#ran","syntology_url":"https://syntology.ai/paper/2204.00185","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.00185"}},"official":{"repos":["staoxiao/libvq"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":2,"ran_from_kinds":["official"]}}},{"url":"/paper/rich-feature-construction-for-the","slug":"rich-feature-construction-for-the","title":"Rich Feature Construction for the Optimization-Generalization Dilemma","date":"2022-03-24","arxiv_id":"2203.15516","repositories_listed":2,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":0,"n_instrument":3,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":3,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/rich-feature-construction-for-the#ran","syntology_url":"https://syntology.ai/paper/2203.15516","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.15516"}},"official":{"repos":["tjujianyu/rfc"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]}}},{"url":"/paper/dq-bart-efficient-sequence-to-sequence-model","slug":"dq-bart-efficient-sequence-to-sequence-model","title":"DQ-BART: Efficient Sequence-to-Sequence Model via Joint Distillation and Quantization","date":"2022-03-21","arxiv_id":"2203.11239","repositories_listed":2,"syntology":{"n":5,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/dq-bart-efficient-sequence-to-sequence-model#ran","syntology_url":"https://syntology.ai/paper/2203.11239","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.11239"}},"official":{"repos":["amazon-research/dq-bart"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":4,"ran_from_kinds":["listed"]}}},{"url":"/paper/cmkd-cnn-transformer-based-cross-model","slug":"cmkd-cnn-transformer-based-cross-model","title":"CMKD: CNN/Transformer-Based Cross-Model Knowledge Distillation for Audio Classification","date":"2022-03-13","arxiv_id":"2203.06760","repositories_listed":2,"syntology":null},{"url":"/paper/transformer-based-knowledge-distillation-for","slug":"transformer-based-knowledge-distillation-for","title":"TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentation","date":"2022-02-27","arxiv_id":"2202.13393","repositories_listed":2,"syntology":null},{"url":"/paper/global-reasoned-multi-task-learning-model-for","slug":"global-reasoned-multi-task-learning-model-for","title":"Global-Reasoned Multi-Task Learning Model for Surgical Scene Understanding","date":"2022-01-28","arxiv_id":"2201.11957","repositories_listed":2,"syntology":{"n":8,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":7,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":8,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified","sample_list":"/paper/global-reasoned-multi-task-learning-model-for#ran","syntology_url":"https://syntology.ai/paper/2201.11957","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2201.11957"}},"official":{"repos":["lalithjets/global-reasoned-multi-task-model"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":4,"ran_from_kinds":["official"]}}},{"url":"/paper/up-to-100x-faster-data-free-knowledge","slug":"up-to-100x-faster-data-free-knowledge","title":"Up to 100$\\times$ Faster Data-free Knowledge Distillation","date":"2021-12-12","arxiv_id":"2112.06253","repositories_listed":2,"syntology":null},{"url":"/paper/add-frequency-attention-and-multi-view-based","slug":"add-frequency-attention-and-multi-view-based","title":"ADD: Frequency Attention and Multi-View based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Images","date":"2021-12-07","arxiv_id":"2112.03553","repositories_listed":2,"syntology":null},{"url":"/paper/a-fast-knowledge-distillation-framework-for","slug":"a-fast-knowledge-distillation-framework-for","title":"A Fast Knowledge Distillation Framework for Visual Recognition","date":"2021-12-02","arxiv_id":"2112.01528","repositories_listed":2,"syntology":null},{"url":"/paper/learning-distilled-collaboration-graph-for","slug":"learning-distilled-collaboration-graph-for","title":"Learning Distilled Collaboration Graph for Multi-Agent Perception","date":"2021-11-01","arxiv_id":"2111.00643","repositories_listed":2,"syntology":{"n":6,"n_ran":4,"n_constructed":4,"n_ran_checked":4,"n_instrument":0,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":4,"n_pointer_only":0,"phrase":"4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 4 samples that ran constructed an object rather than computing a result","sample_list":"/paper/learning-distilled-collaboration-graph-for#ran","syntology_url":"https://syntology.ai/paper/2111.00643","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2111.00643"}},"official":{"repos":["ai4ce/DiscoNet"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/pp-shitu-a-practical-lightweight-image","slug":"pp-shitu-a-practical-lightweight-image","title":"PP-ShiTu: A Practical Lightweight Image Recognition System","date":"2021-11-01","arxiv_id":"2111.00775","repositories_listed":2,"syntology":null},{"url":"/paper/mosaicking-to-distill-knowledge-distillation","slug":"mosaicking-to-distill-knowledge-distillation","title":"Mosaicking to Distill: Knowledge Distillation from Out-of-Domain Data","date":"2021-10-27","arxiv_id":"2110.15094","repositories_listed":2,"syntology":{"n":4,"n_ran":3,"n_constructed":0,"n_ran_checked":2,"n_instrument":1,"n_unverified":1,"n_honours":2,"n_violates":0,"n_no_contract":0,"n_pointer_only":4,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/mosaicking-to-distill-knowledge-distillation#ran","syntology_url":"https://syntology.ai/paper/2110.15094","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2110.15094"}},"official":{"repos":["zju-vipa/mosaickd"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":1,"ran_from_kinds":["official","unlocated"]}}},{"url":"/paper/clonalnet-classifying-better-by-focusing-on","slug":"clonalnet-classifying-better-by-focusing-on","title":"FocusNet: Classifying Better by Focusing on Confusing Classes","date":"2021-10-14","arxiv_id":"2110.07307","repositories_listed":2,"syntology":null},{"url":"/paper/federated-distillation-of-natural-language","slug":"federated-distillation-of-natural-language","title":"KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks","date":"2021-10-06","arxiv_id":"2110.02432","repositories_listed":2,"syntology":null},{"url":"/paper/mixed-supervised-segmentation-confidence","slug":"mixed-supervised-segmentation-confidence","title":"Segmentation with mixed supervision: Confidence maximization helps knowledge distillation","date":"2021-09-21","arxiv_id":"2109.10902","repositories_listed":2,"syntology":null},{"url":"/paper/the-niutrans-system-for-wngt-2020-efficiency-1","slug":"the-niutrans-system-for-wngt-2020-efficiency-1","title":"The NiuTrans System for WNGT 2020 Efficiency Task","date":"2021-09-16","arxiv_id":"2109.08008","repositories_listed":2,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":0,"n_honours":2,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/the-niutrans-system-for-wngt-2020-efficiency-1#ran","syntology_url":"https://syntology.ai/paper/2109.08008","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2109.08008"}},"official":{"repos":["NiuTrans/NiuTrans.NMT","niutrans/niutensor"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/multi-scale-aligned-distillation-for-low-1","slug":"multi-scale-aligned-distillation-for-low-1","title":"Multi-Scale Aligned Distillation for Low-Resolution Detection","date":"2021-09-14","arxiv_id":"2109.06875","repositories_listed":2,"syntology":{"n":4,"n_ran":4,"n_constructed":1,"n_ran_checked":4,"n_instrument":0,"n_unverified":0,"n_honours":1,"n_violates":0,"n_no_contract":3,"n_pointer_only":4,"phrase":"4 ran (of which 1 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/multi-scale-aligned-distillation-for-low-1#ran","syntology_url":"https://syntology.ai/paper/2109.06875","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2109.06875"}},"official":{"repos":["Jia-Research-Lab/MSAD","dvlab-research/msad"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":1,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/libfewshot-a-comprehensive-library-for-few","slug":"libfewshot-a-comprehensive-library-for-few","title":"LibFewShot: A Comprehensive Library for Few-shot Learning","date":"2021-09-10","arxiv_id":"2109.04898","repositories_listed":2,"syntology":{"n":4,"n_ran":4,"n_constructed":0,"n_ran_checked":4,"n_instrument":0,"n_unverified":0,"n_honours":1,"n_violates":0,"n_no_contract":3,"n_pointer_only":0,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/libfewshot-a-comprehensive-library-for-few#ran","syntology_url":"https://syntology.ai/paper/2109.04898","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2109.04898"}},"official":{"repos":["rl-vig/libfewshot"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/supervised-compression-for-resource","slug":"supervised-compression-for-resource","title":"Supervised Compression for Resource-Constrained Edge Computing Systems","date":"2021-08-21","arxiv_id":"2108.11898","repositories_listed":2,"syntology":{"n":17,"n_ran":11,"n_constructed":0,"n_ran_checked":10,"n_instrument":1,"n_unverified":6,"n_honours":0,"n_violates":0,"n_no_contract":10,"n_pointer_only":1,"phrase":"11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified","sample_list":"/paper/supervised-compression-for-resource#ran","syntology_url":"https://syntology.ai/paper/2108.11898","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2108.11898"}},"official":{"repos":["yoshitomo-matsubara/supervised-compression"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":2,"ran_from_kinds":["listed","official","unlocated"]}}},{"url":"/paper/transferring-knowledge-distillation-for","slug":"transferring-knowledge-distillation-for","title":"Transferring Knowledge Distillation for Multilingual Social Event Detection","date":"2021-08-06","arxiv_id":"2108.03084","repositories_listed":2,"syntology":null},{"url":"/paper/cored-generalizing-fake-media-detection-with","slug":"cored-generalizing-fake-media-detection-with","title":"CoReD: Generalizing Fake Media Detection with Continual Representation using Distillation","date":"2021-07-06","arxiv_id":"2107.02408","repositories_listed":2,"syntology":{"n":15,"n_ran":8,"n_constructed":0,"n_ran_checked":8,"n_instrument":0,"n_unverified":7,"n_honours":0,"n_violates":0,"n_no_contract":8,"n_pointer_only":5,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 7 unverified","sample_list":"/paper/cored-generalizing-fake-media-detection-with#ran","syntology_url":"https://syntology.ai/paper/2107.02408","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2107.02408"}},"official":null}},{"url":"/paper/pool-of-experts-realtime-querying-specialized","slug":"pool-of-experts-realtime-querying-specialized","title":"Pool of Experts: Realtime Querying Specialized Knowledge in Massive Neural Networks","date":"2021-07-03","arxiv_id":"2107.01354","repositories_listed":2,"syntology":null},{"url":"/paper/does-knowledge-distillation-really-work","slug":"does-knowledge-distillation-really-work","title":"Does Knowledge Distillation Really Work?","date":"2021-06-10","arxiv_id":"2106.05945","repositories_listed":2,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/does-knowledge-distillation-really-work#ran","syntology_url":"https://syntology.ai/paper/2106.05945","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2106.05945"}},"official":{"repos":["samuelstanton/gnosis"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/knowledge-inheritance-for-pre-trained","slug":"knowledge-inheritance-for-pre-trained","title":"Knowledge Inheritance for Pre-trained Language Models","date":"2021-05-28","arxiv_id":"2105.13880","repositories_listed":2,"syntology":null},{"url":"/paper/backdoor-attacks-on-self-supervised-learning","slug":"backdoor-attacks-on-self-supervised-learning","title":"Backdoor Attacks on Self-Supervised Learning","date":"2021-05-21","arxiv_id":"2105.10123","repositories_listed":2,"syntology":{"n":13,"n_ran":11,"n_constructed":0,"n_ran_checked":5,"n_instrument":6,"n_unverified":2,"n_honours":1,"n_violates":0,"n_no_contract":4,"n_pointer_only":8,"phrase":"11 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/backdoor-attacks-on-self-supervised-learning#ran","syntology_url":"https://syntology.ai/paper/2105.10123","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2105.10123"}},"official":{"repos":["UMBCvision/SSL-Backdoor"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":2,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/contrastive-model-inversion-for-data-free","slug":"contrastive-model-inversion-for-data-free","title":"Contrastive Model Inversion for Data-Free Knowledge Distillation","date":"2021-05-18","arxiv_id":"2105.08584","repositories_listed":2,"syntology":null},{"url":"/paper/boosting-light-weight-depth-estimation-via","slug":"boosting-light-weight-depth-estimation-via","title":"Boosting Light-Weight Depth Estimation Via Knowledge Distillation","date":"2021-05-13","arxiv_id":"2105.06143","repositories_listed":2,"syntology":null},{"url":"/paper/distilling-and-transferring-knowledge-via","slug":"distilling-and-transferring-knowledge-via","title":"Distilling and Transferring Knowledge via cGAN-generated Samples for Image Classification and Regression","date":"2021-04-07","arxiv_id":"2104.03164","repositories_listed":2,"syntology":null},{"url":"/paper/unsupervised-domain-expansion-for-visual","slug":"unsupervised-domain-expansion-for-visual","title":"Unsupervised Domain Expansion for Visual Categorization","date":"2021-04-01","arxiv_id":"2104.00233","repositories_listed":2,"syntology":{"n":11,"n_ran":10,"n_constructed":0,"n_ran_checked":7,"n_instrument":3,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":7,"n_pointer_only":1,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/unsupervised-domain-expansion-for-visual#ran","syntology_url":"https://syntology.ai/paper/2104.00233","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2104.00233"}},"official":{"repos":["li-xirong/ude"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/embedding-transfer-with-label-relaxation-for","slug":"embedding-transfer-with-label-relaxation-for","title":"Embedding Transfer with Label Relaxation for Improved Metric Learning","date":"2021-03-27","arxiv_id":"2103.14908","repositories_listed":2,"syntology":null},{"url":"/paper/beyond-self-supervision-a-simple-yet","slug":"beyond-self-supervision-a-simple-yet","title":"Beyond Self-Supervision: A Simple Yet Effective Network Distillation Alternative to Improve Backbones","date":"2021-03-10","arxiv_id":"2103.05959","repositories_listed":2,"syntology":null},{"url":"/paper/parser-free-virtual-try-on-via-distilling","slug":"parser-free-virtual-try-on-via-distilling","title":"Parser-Free Virtual Try-on via Distilling Appearance Flows","date":"2021-03-08","arxiv_id":"2103.04559","repositories_listed":2,"syntology":null},{"url":"/paper/distilling-knowledge-via-intermediate","slug":"distilling-knowledge-via-intermediate","title":"Distilling Knowledge via Intermediate Classifiers","date":"2021-02-28","arxiv_id":"2103.00497","repositories_listed":2,"syntology":null},{"url":"/paper/localization-distillation-for-object","slug":"localization-distillation-for-object","title":"Localization Distillation for Dense Object Detection","date":"2021-02-24","arxiv_id":"2102.12252","repositories_listed":2,"syntology":null},{"url":"/paper/knowledge-distillation-in-iterative","slug":"knowledge-distillation-in-iterative","title":"Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed","date":"2021-01-07","arxiv_id":"2101.02388","repositories_listed":2,"syntology":null},{"url":"/paper/exploring-inter-channel-correlation-for","slug":"exploring-inter-channel-correlation-for","title":"Exploring Inter-Channel Correlation for Diversity-Preserved Knowledge Distillation","date":"2021-01-01","arxiv_id":null,"repositories_listed":2,"syntology":null},{"url":"/paper/progressive-network-grafting-for-few-shot","slug":"progressive-network-grafting-for-few-shot","title":"Progressive Network Grafting for Few-Shot Knowledge Distillation","date":"2020-12-09","arxiv_id":"2012.04915","repositories_listed":2,"syntology":null},{"url":"/paper/de-rrd-a-knowledge-distillation-framework-for","slug":"de-rrd-a-knowledge-distillation-framework-for","title":"DE-RRD: A Knowledge Distillation Framework for Recommender System","date":"2020-12-08","arxiv_id":"2012.04357","repositories_listed":2,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/de-rrd-a-knowledge-distillation-framework-for#ran","syntology_url":"https://syntology.ai/paper/2012.04357","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2012.04357"}},"official":{"repos":["SeongKu-Kang/DE-RRD_CIKM20"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/cross-layer-distillation-with-semantic","slug":"cross-layer-distillation-with-semantic","title":"Cross-Layer Distillation with Semantic Calibration","date":"2020-12-06","arxiv_id":"2012.03236","repositories_listed":2,"syntology":null},{"url":"/paper/head-network-distillation-splitting-distilled","slug":"head-network-distillation-splitting-distilled","title":"Head Network Distillation: Splitting Distilled Deep Neural Networks for Resource-Constrained Edge Computing Systems","date":"2020-11-20","arxiv_id":null,"repositories_listed":2,"syntology":null},{"url":"/paper/fastformers-highly-efficient-transformer","slug":"fastformers-highly-efficient-transformer","title":"FastFormers: Highly Efficient Transformer Models for Natural Language Understanding","date":"2020-10-26","arxiv_id":"2010.13382","repositories_listed":2,"syntology":{"n":1,"n_ran":0,"n_constructed":0,"n_ran_checked":0,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"0 ran · 1 unverified","sample_list":"/paper/fastformers-highly-efficient-transformer#ran","syntology_url":"https://syntology.ai/paper/2010.13382","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.13382"}},"official":{"repos":["microsoft/fastformers"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":[]}}},{"url":"/paper/distilling-dense-representations-for-ranking","slug":"distilling-dense-representations-for-ranking","title":"Distilling Dense Representations for Ranking using Tightly-Coupled Teachers","date":"2020-10-22","arxiv_id":"2010.11386","repositories_listed":2,"syntology":null},{"url":"/paper/why-skip-if-you-can-combine-a-simple","slug":"why-skip-if-you-can-combine-a-simple","title":"Why Skip If You Can Combine: A Simple Knowledge Distillation Technique for Intermediate Layers","date":"2020-10-06","arxiv_id":"2010.03034","repositories_listed":2,"syntology":{"n":3,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/why-skip-if-you-can-combine-a-simple#ran","syntology_url":"https://syntology.ai/paper/2010.03034","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.03034"}},"official":{"repos":["yimeng0701/CKD_pytorch"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":2,"ran_from_kinds":["listed"]}}},{"url":"/paper/autoregressive-knowledge-distillation-through","slug":"autoregressive-knowledge-distillation-through","title":"Autoregressive Knowledge Distillation through Imitation Learning","date":"2020-09-15","arxiv_id":"2009.07253","repositories_listed":2,"syntology":null},{"url":"/paper/unpaired-learning-of-deep-image-denoising","slug":"unpaired-learning-of-deep-image-denoising","title":"Unpaired Learning of Deep Image Denoising","date":"2020-08-31","arxiv_id":"2008.13711","repositories_listed":2,"syntology":null},{"url":"/paper/performance-optimization-for-federated-person","slug":"performance-optimization-for-federated-person","title":"Performance Optimization for Federated Person Re-identification via Benchmark Analysis","date":"2020-08-26","arxiv_id":"2008.11560","repositories_listed":2,"syntology":null},{"url":"/paper/group-knowledge-transfer-collaborative","slug":"group-knowledge-transfer-collaborative","title":"Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge","date":"2020-07-28","arxiv_id":"2007.14513","repositories_listed":2,"syntology":{"n":4,"n_ran":3,"n_constructed":0,"n_ran_checked":2,"n_instrument":1,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/group-knowledge-transfer-collaborative#ran","syntology_url":"https://syntology.ai/paper/2007.14513","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2007.14513"}},"official":{"repos":["FedML-AI/FedML"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/ratt-recurrent-attention-to-transient-tasks","slug":"ratt-recurrent-attention-to-transient-tasks","title":"RATT: Recurrent Attention to Transient Tasks for Continual Image Captioning","date":"2020-07-13","arxiv_id":"2007.06271","repositories_listed":2,"syntology":null},{"url":"/paper/deep-encoder-shallow-decoder-reevaluating-the","slug":"deep-encoder-shallow-decoder-reevaluating-the","title":"Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translation","date":"2020-06-18","arxiv_id":"2006.10369","repositories_listed":2,"syntology":{"n":5,"n_ran":3,"n_constructed":0,"n_ran_checked":3,"n_instrument":0,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":3,"n_pointer_only":1,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/deep-encoder-shallow-decoder-reevaluating-the#ran","syntology_url":"https://syntology.ai/paper/2006.10369","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.10369"}},"official":{"repos":["jungokasai/deep-shallow"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/self-supervised-knowledge-distillation-for","slug":"self-supervised-knowledge-distillation-for","title":"Self-supervised Knowledge Distillation for Few-shot Learning","date":"2020-06-17","arxiv_id":"2006.09785","repositories_listed":2,"syntology":null},{"url":"/paper/knowledge-distillation-meets-self-supervision","slug":"knowledge-distillation-meets-self-supervision","title":"Knowledge Distillation Meets Self-Supervision","date":"2020-06-12","arxiv_id":"2006.07114","repositories_listed":2,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/knowledge-distillation-meets-self-supervision#ran","syntology_url":"https://syntology.ai/paper/2006.07114","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.07114"}},"official":{"repos":["xuguodong03/SSKD"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/distilling-image-dehazing-with-heterogeneous","slug":"distilling-image-dehazing-with-heterogeneous","title":"Distilling Image Dehazing With Heterogeneous Task Imitation","date":"2020-06-01","arxiv_id":null,"repositories_listed":2,"syntology":null},{"url":"/paper/joint-progressive-knowledge-distillation-and","slug":"joint-progressive-knowledge-distillation-and","title":"Joint Progressive Knowledge Distillation and Unsupervised Domain Adaptation","date":"2020-05-16","arxiv_id":"2005.07839","repositories_listed":2,"syntology":null},{"url":"/paper/knowledge-distillation-and-student-teacher","slug":"knowledge-distillation-and-student-teacher","title":"Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlooks","date":"2020-04-13","arxiv_id":"2004.05937","repositories_listed":2,"syntology":null},{"url":"/paper/squeezed-deep-6dof-object-detection-using","slug":"squeezed-deep-6dof-object-detection-using","title":"Squeezed Deep 6DoF Object Detection Using Knowledge Distillation","date":"2020-03-30","arxiv_id":"2003.13586","repositories_listed":2,"syntology":null},{"url":"/paper/incremental-object-detection-via-meta","slug":"incremental-object-detection-via-meta","title":"Incremental Object Detection via Meta-Learning","date":"2020-03-17","arxiv_id":"2003.08798","repositories_listed":2,"syntology":{"n":9,"n_ran":7,"n_constructed":0,"n_ran_checked":6,"n_instrument":1,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":9,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/incremental-object-detection-via-meta#ran","syntology_url":"https://syntology.ai/paper/2003.08798","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2003.08798"}},"official":{"repos":["JosephKJ/iOD"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":2,"ran_from_kinds":["official","unlocated"]}}},{"url":"/paper/supermix-supervising-the-mixing-data","slug":"supermix-supervising-the-mixing-data","title":"SuperMix: Supervising the Mixing Data Augmentation","date":"2020-03-10","arxiv_id":"2003.05034","repositories_listed":2,"syntology":{"n":4,"n_ran":4,"n_constructed":0,"n_ran_checked":1,"n_instrument":3,"n_unverified":0,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":4,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/supermix-supervising-the-mixing-data#ran","syntology_url":"https://syntology.ai/paper/2003.05034","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2003.05034"}},"official":{"repos":["alldbi/SuperMix"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/salvaging-federated-learning-by-local","slug":"salvaging-federated-learning-by-local","title":"Salvaging Federated Learning by Local Adaptation","date":"2020-02-12","arxiv_id":"2002.04758","repositories_listed":2,"syntology":{"n":8,"n_ran":3,"n_constructed":0,"n_ran_checked":3,"n_instrument":0,"n_unverified":5,"n_honours":0,"n_violates":0,"n_no_contract":3,"n_pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified","sample_list":"/paper/salvaging-federated-learning-by-local#ran","syntology_url":"https://syntology.ai/paper/2002.04758","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2002.04758"}},"official":{"repos":["ebagdasa/federated_adaptation"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":4,"ran_from_kinds":["official"]}}},{"url":"/paper/suod-toward-scalable-unsupervised-outlier","slug":"suod-toward-scalable-unsupervised-outlier","title":"SUOD: Toward Scalable Unsupervised Outlier Detection","date":"2020-02-08","arxiv_id":"2002.03222","repositories_listed":2,"syntology":null},{"url":"/paper/bert-of-theseus-compressing-bert-by","slug":"bert-of-theseus-compressing-bert-by","title":"BERT-of-Theseus: Compressing BERT by Progressive Module Replacing","date":"2020-02-07","arxiv_id":"2002.02925","repositories_listed":2,"syntology":{"n":5,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/bert-of-theseus-compressing-bert-by#ran","syntology_url":"https://syntology.ai/paper/2002.02925","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2002.02925"}},"official":{"repos":["JetRunner/BERT-of-Theseus"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":4,"ran_from_kinds":["listed"]}}}],"record_sha256":"71447783e0b2be33dbfe4da072363b86b4e1fa86aa4286098ce030c2c919b2c4","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}