{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/how-far-can-we-go-without-convolution","title":"How far can we go without convolution: Improving fully-connected networks","arxiv_id":"1511.02580","date":"2015-11-09","proceeding":null,"authors":["Zhouhan Lin","Roland Memisevic","Kishore Konda"],"abstract":"We propose ways to improve the performance of fully connected networks. We\nfound that two approaches in particular have a strong effect on performance:\nlinear bottleneck layers and unsupervised pre-training using autoencoders\nwithout hidden unit biases. We show how both approaches can be related to\nimproving gradient flow and reducing sparsity in the network. We show that a\nfully connected network can yield approximately 70% classification accuracy on\nthe permutation-invariant CIFAR-10 task, which is much higher than the current\nstate-of-the-art. By adding deformations to the training data, the fully\nconnected network achieves 78% accuracy, which is just 10% short of a decent\nconvolutional network.","url_abs":"http://arxiv.org/abs/1511.02580v1","url_pdf":"http://arxiv.org/pdf/1511.02580v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"how-far-can-we-go-without-convolution","repo_url":"https://github.com/hantek/zlinnet","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"BSD-3-Clause"}},{"paper_slug":"how-far-can-we-go-without-convolution","repo_url":"https://github.com/AvocadoAlpha/boltz_bo","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"how-far-can-we-go-without-convolution","repo_url":"https://github.com/monsta-hd/boltzmann-machines","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"how-far-can-we-go-without-convolution","repo_url":"https://github.com/rickyHong/Boltzman-repl","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"how-far-can-we-go-without-convolution","repo_url":"https://github.com/yell/boltzmann-machines","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"classification","task_name":"General Classification"},{"task_slug":"unsupervised-pre-training","task_name":"Unsupervised Pre-training"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1511.02580","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1511.02580"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/rickyHong/Boltzman-repl","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/AvocadoAlpha/boltz_bo","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hantek/zlinnet","reach":{"status":"ok","spdx":"BSD-3-Clause"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yell/boltzmann-machines","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/monsta-hd/boltzmann-machines","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":10},"by_repo_kind":{"listed":{"samples":10,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"7d53c209866447c7","entry":"horizontal_mirror","repo":"AvocadoAlpha/boltz_bo","repo_kind":"listed","path":"boltzmann_machines/utils/augmentation.py","file_url":"https://github.com/AvocadoAlpha/boltz_bo/blob/HEAD/boltzmann_machines/utils/augmentation.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7d53c209866447c7"}},{"code_sha256_prefix":"1c837404b6f6d817","entry":"im_flatten","repo":"AvocadoAlpha/boltz_bo","repo_kind":"listed","path":"boltzmann_machines/utils/dataset.py","file_url":"https://github.com/AvocadoAlpha/boltz_bo/blob/HEAD/boltzmann_machines/utils/dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1c837404b6f6d817"}},{"code_sha256_prefix":"2e474f6cbba24ad0","entry":"im_gif","repo":"AvocadoAlpha/boltz_bo","repo_kind":"listed","path":"boltzmann_machines/utils/plot_utils.py","file_url":"https://github.com/AvocadoAlpha/boltz_bo/blob/HEAD/boltzmann_machines/utils/plot_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2e474f6cbba24ad0"}},{"code_sha256_prefix":"a77f4aba05ee54b0","entry":"im_reshape","repo":"AvocadoAlpha/boltz_bo","repo_kind":"listed","path":"boltzmann_machines/utils/plot_utils.py","file_url":"https://github.com/AvocadoAlpha/boltz_bo/blob/HEAD/boltzmann_machines/utils/plot_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a77f4aba05ee54b0"}},{"code_sha256_prefix":"8458ac32d9281d6c","entry":"load_cifar10","repo":"AvocadoAlpha/boltz_bo","repo_kind":"listed","path":"boltzmann_machines/utils/dataset.py","file_url":"https://github.com/AvocadoAlpha/boltz_bo/blob/HEAD/boltzmann_machines/utils/dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8458ac32d9281d6c"}},{"code_sha256_prefix":"f2bf14cc230e210e","entry":"load_mnist","repo":"AvocadoAlpha/boltz_bo","repo_kind":"listed","path":"boltzmann_machines/utils/dataset.py","file_url":"https://github.com/AvocadoAlpha/boltz_bo/blob/HEAD/boltzmann_machines/utils/dataset.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f2bf14cc230e210e"}},{"code_sha256_prefix":"f0427045c65ace8d","entry":"logit_mean","repo":"AvocadoAlpha/boltz_bo","repo_kind":"listed","path":"boltzmann_machines/rbm/rbm.py","file_url":"https://github.com/AvocadoAlpha/boltz_bo/blob/HEAD/boltzmann_machines/rbm/rbm.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f0427045c65ace8d"}},{"code_sha256_prefix":"520feb68778834ef","entry":"plot_confusion_matrix","repo":"AvocadoAlpha/boltz_bo","repo_kind":"listed","path":"boltzmann_machines/utils/plot_utils.py","file_url":"https://github.com/AvocadoAlpha/boltz_bo/blob/HEAD/boltzmann_machines/utils/plot_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"520feb68778834ef"}},{"code_sha256_prefix":"ce09e2fb56e9c089","entry":"run_in_tf_session","repo":"AvocadoAlpha/boltz_bo","repo_kind":"listed","path":"boltzmann_machines/base/tf_model.py","file_url":"https://github.com/AvocadoAlpha/boltz_bo/blob/HEAD/boltzmann_machines/base/tf_model.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ce09e2fb56e9c089"}},{"code_sha256_prefix":"2d6cfc56420ba55a","entry":"shift","repo":"AvocadoAlpha/boltz_bo","repo_kind":"listed","path":"boltzmann_machines/utils/augmentation.py","file_url":"https://github.com/AvocadoAlpha/boltz_bo/blob/HEAD/boltzmann_machines/utils/augmentation.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2d6cfc56420ba55a"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}