{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/train-and-you-ll-miss-it-interactive-model","title":"Train and You'll Miss It: Interactive Model Iteration with Weak Supervision and Pre-Trained Embeddings","arxiv_id":"2006.15168","date":"2020-06-26","proceeding":null,"authors":["Mayee F. Chen","Daniel Y. Fu","Frederic Sala","Sen Wu","Ravi Teja Mullapudi","Fait Poms","Kayvon Fatahalian","Christopher Ré"],"abstract":"Our goal is to enable machine learning systems to be trained interactively. This requires models that perform well and train quickly, without large amounts of hand-labeled data. We take a step forward in this direction by borrowing from weak supervision (WS), wherein models can be trained with noisy sources of signal instead of hand-labeled data. But WS relies on training downstream deep networks to extrapolate to unseen data points, which can take hours or days. Pre-trained embeddings can remove this requirement. We do not use the embeddings as features as in transfer learning (TL), which requires fine-tuning for high performance, but instead use them to define a distance function on the data and extend WS source votes to nearby points. Theoretically, we provide a series of results studying how performance scales with changes in source coverage, source accuracy, and the Lipschitzness of label distributions in the embedding space, and compare this rate to standard WS without extension and TL without fine-tuning. On six benchmark NLP and video tasks, our method outperforms WS without extension by 4.1 points, TL without fine-tuning by 12.8 points, and traditionally-supervised deep networks by 13.1 points, and comes within 0.7 points of state-of-the-art weakly-supervised deep networks-all while training in less than half a second.","url_abs":"https://arxiv.org/abs/2006.15168v1","url_pdf":"https://arxiv.org/pdf/2006.15168v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"train-and-you-ll-miss-it-interactive-model","repo_url":"https://github.com/HazyResearch/epoxy","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"transfer-learning","task_name":"Transfer Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2006.15168","atlas_url":"https://app.syntology.ai/?focus=2006.15168","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.15168"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/HazyResearch/epoxy","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":3},"by_repo_kind":{"listed":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"cd4cec6ed1f7d815","entry":"preprocess_lfs","repo":"HazyResearch/epoxy","repo_kind":"listed","path":"epoxy/epoxy.py","file_url":"https://github.com/HazyResearch/epoxy/blob/HEAD/epoxy/epoxy.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"cd4cec6ed1f7d815"}},{"code_sha256_prefix":"5ee9de782b373bce","entry":"pytorch_cosine_similarity","repo":"HazyResearch/epoxy","repo_kind":"listed","path":"epoxy/epoxy.py","file_url":"https://github.com/HazyResearch/epoxy/blob/HEAD/epoxy/epoxy.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5ee9de782b373bce"}},{"code_sha256_prefix":"dc7324424481f4a0","entry":"pytorch_l2_distance","repo":"HazyResearch/epoxy","repo_kind":"listed","path":"epoxy/epoxy.py","file_url":"https://github.com/HazyResearch/epoxy/blob/HEAD/epoxy/epoxy.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"dc7324424481f4a0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}