{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/understanding-deep-architectures-with","title":"Understanding Deep Architectures with Reasoning Layer","arxiv_id":"2006.13401","date":"2020-06-24","proceeding":null,"authors":["Xinshi Chen","Yufei Zhang","Christoph Reisinger","Le Song"],"abstract":"Recently, there has been a surge of interest in combining deep learning models with reasoning in order to handle more sophisticated learning tasks. In many cases, a reasoning task can be solved by an iterative algorithm. This algorithm is often unrolled, and used as a specialized layer in the deep architecture, which can be trained end-to-end with other neural components. Although such hybrid deep architectures have led to many empirical successes, the theoretical foundation of such architectures, especially the interplay between algorithm layers and other neural layers, remains largely unexplored. In this paper, we take an initial step towards an understanding of such hybrid deep architectures by showing that properties of the algorithm layers, such as convergence, stability, and sensitivity, are intimately related to the approximation and generalization abilities of the end-to-end model. Furthermore, our analysis matches closely our experimental observations under various conditions, suggesting that our theory can provide useful guidelines for designing deep architectures with reasoning layers.","url_abs":"https://arxiv.org/abs/2006.13401v2","url_pdf":"https://arxiv.org/pdf/2006.13401v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"understanding-deep-architectures-with","repo_url":"https://github.com/xinshi-chen/Deep-Architecture-With-Reasoning-Layer","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2006.13401","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.13401"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/xinshi-chen/Deep-Architecture-With-Reasoning-Layer","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":5},"by_repo_kind":{"official":{"samples":5,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"b71b75edf63b4209","entry":"diff_soft_threshold","repo":"xinshi-chen/Deep-Architecture-With-Reasoning-Layer","repo_kind":"official","path":"neuralalgo/common/utils.py","file_url":"https://github.com/xinshi-chen/Deep-Architecture-With-Reasoning-Layer/blob/HEAD/neuralalgo/common/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b71b75edf63b4209"}},{"code_sha256_prefix":"2e7cf59bdadcc34a","entry":"qeq","repo":"xinshi-chen/Deep-Architecture-With-Reasoning-Layer","repo_kind":"official","path":"neuralalgo/model.py","file_url":"https://github.com/xinshi-chen/Deep-Architecture-With-Reasoning-Layer/blob/HEAD/neuralalgo/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2e7cf59bdadcc34a"}},{"code_sha256_prefix":"f11ef4b9c18f2830","entry":"qeq_inv","repo":"xinshi-chen/Deep-Architecture-With-Reasoning-Layer","repo_kind":"official","path":"neuralalgo/model.py","file_url":"https://github.com/xinshi-chen/Deep-Architecture-With-Reasoning-Layer/blob/HEAD/neuralalgo/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f11ef4b9c18f2830"}},{"code_sha256_prefix":"ae6cdd8dfd9a5745","entry":"torch_rand_choice","repo":"xinshi-chen/Deep-Architecture-With-Reasoning-Layer","repo_kind":"official","path":"neuralalgo/common/utils.py","file_url":"https://github.com/xinshi-chen/Deep-Architecture-With-Reasoning-Layer/blob/HEAD/neuralalgo/common/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ae6cdd8dfd9a5745"}},{"code_sha256_prefix":"230b846b3fc46bb6","entry":"torch_rand_choice_woreplace","repo":"xinshi-chen/Deep-Architecture-With-Reasoning-Layer","repo_kind":"official","path":"neuralalgo/common/utils.py","file_url":"https://github.com/xinshi-chen/Deep-Architecture-With-Reasoning-Layer/blob/HEAD/neuralalgo/common/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"230b846b3fc46bb6"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}