{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/dmcl-distillation-multiple-choice-learning","title":"DMCL: Distillation Multiple Choice Learning for Multimodal Action Recognition","arxiv_id":"1912.10982","date":"2019-12-23","proceeding":null,"authors":["Nuno C. Garcia","Sarah Adel Bargal","Vitaly Ablavsky","Pietro Morerio","Vittorio Murino","Stan Sclaroff"],"abstract":"In this work, we address the problem of learning an ensemble of specialist networks using multimodal data, while considering the realistic and challenging scenario of possible missing modalities at test time. Our goal is to leverage the complementary information of multiple modalities to the benefit of the ensemble and each individual network. We introduce a novel Distillation Multiple Choice Learning framework for multimodal data, where different modality networks learn in a cooperative setting from scratch, strengthening one another. The modality networks learned using our method achieve significantly higher accuracy than if trained separately, due to the guidance of other modalities. We evaluate this approach on three video action recognition benchmark datasets. We obtain state-of-the-art results in comparison to other approaches that work with missing modalities at test time.","url_abs":"https://arxiv.org/abs/1912.10982v1","url_pdf":"https://arxiv.org/pdf/1912.10982v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"dmcl-distillation-multiple-choice-learning","repo_url":"https://github.com/ncgarcia/DMCL","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"dmcl-distillation-multiple-choice-learning","repo_url":"https://github.com/yangyucheng000/Paper-3/tree/main/opendmc","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null}],"tasks":[{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"multiple-choice","task_name":"Multiple-choice"},{"task_slug":"action-recognition","task_name":"Temporal Action Localization"}],"methods":[{"method_slug":"test","method_name":"Test"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1912.10982","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1912.10982"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ncgarcia/DMCL","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yangyucheng000/Paper-3/tree/main/opendmc","reach":null}],"summary":{"ran_draft_wrong":1,"unverified":3},"by_repo_kind":{"official":{"samples":4,"ran":1,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":4,"samples":[{"code_sha256_prefix":"bf825c12d7fad12f","entry":"get_train_test_path","repo":"ncgarcia/DMCL","repo_kind":"official","path":"codebase/utils.py","file_url":"https://github.com/ncgarcia/DMCL/blob/HEAD/codebase/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bf825c12d7fad12f"}},{"code_sha256_prefix":"a50739251716b4fb","entry":"get_nwucla_fnames","repo":"ncgarcia/DMCL","repo_kind":"official","path":"codebase/utils.py","file_url":"https://github.com/ncgarcia/DMCL/blob/HEAD/codebase/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a50739251716b4fb"}},{"code_sha256_prefix":"7abf6b50695fa16a","entry":"get_tfrecords_nwucla","repo":"ncgarcia/DMCL","repo_kind":"official","path":"codebase/preproc/make_lists/make_list_dset_nwucla.py","file_url":"https://github.com/ncgarcia/DMCL/blob/HEAD/codebase/preproc/make_lists/make_list_dset_nwucla.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"7abf6b50695fa16a"}},{"code_sha256_prefix":"f0ab00ba466b1738","entry":"get_uwa3d_filenames","repo":"ncgarcia/DMCL","repo_kind":"official","path":"codebase/utils.py","file_url":"https://github.com/ncgarcia/DMCL/blob/HEAD/codebase/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f0ab00ba466b1738"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}