{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/0-1-deep-neural-networks-via-block-coordinate","title":"0/1 Deep Neural Networks via Block Coordinate Descent","arxiv_id":"2206.09379","date":"2022-06-19","proceeding":null,"authors":["HUI ZHANG","Shenglong Zhou","Geoffrey Ye Li","Naihua Xiu"],"abstract":"The step function is one of the simplest and most natural activation functions for deep neural networks (DNNs). As it counts 1 for positive variables and 0 for others, its intrinsic characteristics (e.g., discontinuity and no viable information of subgradients) impede its development for several decades. Even if there is an impressive body of work on designing DNNs with continuous activation functions that can be deemed as surrogates of the step function, it is still in the possession of some advantageous properties, such as complete robustness to outliers and being capable of attaining the best learning-theoretic guarantee of predictive accuracy. Hence, in this paper, we aim to train DNNs with the step function used as an activation function (dubbed as 0/1 DNNs). We first reformulate 0/1 DNNs as an unconstrained optimization problem and then solve it by a block coordinate descend (BCD) method. Moreover, we acquire closed-form solutions for sub-problems of BCD as well as its convergence properties. Furthermore, we also integrate $\\ell_{2,0}$-regularization into 0/1 DNN to accelerate the training process and compress the network scale. As a result, the proposed algorithm has a high performance on classifying MNIST and Fashion-MNIST datasets. As a result, the proposed algorithm has a desirable performance on classifying MNIST, FashionMNIST, Cifar10, and Cifar100 datasets.","url_abs":"https://arxiv.org/abs/2206.09379v2","url_pdf":"https://arxiv.org/pdf/2206.09379v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"10-shot-image-generation","task_name":"10-shot image generation"},{"task_slug":"16k","task_name":"16k"},{"task_slug":"2d-object-detection","task_name":"2D Object Detection"},{"task_slug":"3d-face-alignment","task_name":"3D Face Alignment"},{"task_slug":"3d-facial-expression-recognition","task_name":"3D Facial Expression Recognition"},{"task_slug":"3d-facial-landmark-localization","task_name":"3D Facial Landmark Localization"},{"task_slug":"3d-hand-pose-estimation","task_name":"3D Hand Pose Estimation"},{"task_slug":"3d-instance-segmentation-1","task_name":"3D Instance Segmentation"},{"task_slug":"3d-lane-detection","task_name":"3D Lane Detection"},{"task_slug":"3d-multi-object-tracking","task_name":"3D Multi-Object Tracking"},{"task_slug":"3d-place-recognition","task_name":"3D Place Recognition"},{"task_slug":"3d-dense-captioning","task_name":"3D dense captioning"},{"task_slug":"abstractive-text-summarization","task_name":"Abstractive Text Summarization"},{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"anomaly-detection","task_name":"Anomaly Detection"},{"task_slug":"arithmetic-reasoning","task_name":"Arithmetic Reasoning"},{"task_slug":"articles","task_name":"Articles"},{"task_slug":"asthmatic-lung-sound-classification","task_name":"Asthmatic Lung Sound Classification"},{"task_slug":"audio-classification","task_name":"Audio Classification"},{"task_slug":"change-detection","task_name":"Change Detection"},{"task_slug":"classification-1","task_name":"Classification"},{"task_slug":"click-through-rate-prediction","task_name":"Click-Through Rate Prediction"},{"task_slug":"code-generation","task_name":"Code Generation"},{"task_slug":"color-image-denoising","task_name":"Color Image Denoising"},{"task_slug":"common-sense-reasoning","task_name":"Common Sense Reasoning"},{"task_slug":"cross-domain-few-shot-object-detection","task_name":"Cross-Domain Few-Shot Object Detection"},{"task_slug":"deblurring","task_name":"Deblurring"},{"task_slug":"deepfake-detection","task_name":"DeepFake Detection"},{"task_slug":"denoising","task_name":"Denoising"},{"task_slug":"depth-estimation","task_name":"Depth Estimation"},{"task_slug":"domain-generalization","task_name":"Domain Generalization"},{"task_slug":"drug-discovery","task_name":"Drug Discovery"},{"task_slug":"eeg-4-classes","task_name":"EEG 4 classes"},{"task_slug":"face-detection","task_name":"Face Detection"},{"task_slug":"face-recognition","task_name":"Face Recognition"},{"task_slug":"fake-image-detection","task_name":"Fake Image Detection"},{"task_slug":"fine-grained-image-classification","task_name":"Fine-Grained Image Classification"},{"task_slug":"fracture-detection","task_name":"Fracture detection"},{"task_slug":"fraud-detection","task_name":"Fraud Detection"},{"task_slug":"gloss-free-sign-language-translation","task_name":"Gloss-free Sign Language Translation"},{"task_slug":"graph-classification","task_name":"Graph Classification"},{"task_slug":"handwritten-mathmatical-expression","task_name":"Handwritten Mathmatical Expression Recognition"},{"task_slug":"hateful-meme-classification","task_name":"Hateful Meme Classification"},{"task_slug":"highlight-detection","task_name":"Highlight Detection"},{"task_slug":"image-captioning","task_name":"Image Captioning"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"image-dehazing","task_name":"Image Dehazing"},{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"keyword-spotting","task_name":"Keyword Spotting"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"license-plate-detection","task_name":"License Plate Detection"},{"task_slug":"long-range-modeling","task_name":"Long-range modeling"},{"task_slug":"low-light-image-enhancement","task_name":"Low-Light Image Enhancement"},{"task_slug":"machine-translation","task_name":"Machine Translation"},{"task_slug":"medical-image-segmentation","task_name":"Medical Image Segmentation"},{"task_slug":"meme-classification","task_name":"Meme Classification"},{"task_slug":"monocular-depth-estimation","task_name":"Monocular Depth Estimation"},{"task_slug":"multi-label-classification","task_name":"Multi-Label Classification"},{"task_slug":"multi-object-tracking","task_name":"Multi-Object Tracking"},{"task_slug":"multimodal-emotion-recognition","task_name":"Multimodal Emotion Recognition"},{"task_slug":"multimodal-intent-recognition","task_name":"Multimodal Intent Recognition"},{"task_slug":"music-source-separation","task_name":"Music Source Separation"},{"task_slug":"navsim","task_name":"NavSim"},{"task_slug":"novel-view-synthesis","task_name":"Novel View Synthesis"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"object-detection-in-aerial-images","task_name":"Object Detection In Aerial Images"},{"task_slug":"object-rearrangement","task_name":"Object Rearrangement"},{"task_slug":"object-tracking","task_name":"Object Tracking"},{"task_slug":"person-re-identification","task_name":"Person Re-Identification"},{"task_slug":"phone-level-pronunciation-scoring","task_name":"Phone-level pronunciation scoring"},{"task_slug":"pose-estimation","task_name":"Pose Estimation"},{"task_slug":"question-answering","task_name":"Question Answering"},{"task_slug":"railway-track-image-classification","task_name":"Railway Track Image Classification"},{"task_slug":"real-time-object-detection","task_name":"Real-Time Object Detection"},{"task_slug":"rgb-t-tracking","task_name":"Rgb-T Tracking"},{"task_slug":"robot-manipulation","task_name":"Robot Manipulation"},{"task_slug":"robot-manipulation-generalization","task_name":"Robot Manipulation Generalization"},{"task_slug":"robot-task-planning","task_name":"Robot Task Planning"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"speech-enhancement","task_name":"Speech Enhancement"},{"task_slug":"speech-recognition","task_name":"Speech Recognition"},{"task_slug":"style-transfer","task_name":"Style Transfer"},{"task_slug":"table-to-text-generation","task_name":"Table-to-Text Generation"},{"task_slug":"temporal-relation-extraction","task_name":"Temporal Relation Extraction"},{"task_slug":"text-to-3d","task_name":"Text to 3D"},{"task_slug":"text-to-image-generation","task_name":"Text-to-Image Generation"},{"task_slug":"universal-domain-adaptation","task_name":"Universal Domain Adaptation"},{"task_slug":"unsupervised-domain-adaptation","task_name":"Unsupervised Domain Adaptation"},{"task_slug":"video-generation","task_name":"Video Generation"},{"task_slug":"video-question-answering","task_name":"Video Question Answering"},{"task_slug":"video-deraining","task_name":"Video deraining"},{"task_slug":"virtual-try-on","task_name":"Virtual Try-on"},{"task_slug":"visual-object-tracking","task_name":"Visual Object Tracking"},{"task_slug":"weakly-supervised-action-localization","task_name":"Weakly Supervised Action Localization"},{"task_slug":"zeroshot-video-question-answer","task_name":"Zero-Shot Video Question Answer"}],"methods":[{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"(deleted method)"},{"method_slug":null,"method_name":"(fAQ)*[ASK EXPEDIA]what does \"refundable\" mean on expedia flights"},{"method_slug":null,"method_name":"06 Way: Expedia Name Change Policy |step-by-step"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"12 Ways To Trezor Wallet Care at Your Fingertips: A Complete Guide to Phone Email and Chat Support"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"17 Effective Ways to Get Help from Trezor Wallet Support"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"20 Easy Tricks to Reach Roadrunner Support Instantly"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"21 Methods to Reach Live Support at Priceline"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"24/7 Uphold Support: Get Help Anytime, Anywhere"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"7 Ways to Get Real Help from Trezor Wallet Support Fast"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"8 Best Ways to Get in Touch with Uphold Login Issue Live Support"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"AI Girlfriend Review 2025: 10 Virtual Lovers That Will Make You Forget Reality (Seriously)"},{"method_slug":null,"method_name":"Brass Name Plaque"},{"method_slug":null,"method_name":"CFlines"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"Charles Schwab Support"},{"method_slug":null,"method_name":"Contact Information"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"Everything You Need to Know to Contact SBCGlobal Email Support"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"How Office Furniture Impacts Productivity in Kuwait Workspaces"},{"method_slug":null,"method_name":"How Super Precision Bearings Enhance Efficiency in CNC Machines and Robotics"},{"method_slug":null,"method_name":"How did I Contact KrakenWallet Support: Live Person Call, Chat HElp"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"Identify the Issue"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"Jack Thomas"},{"method_slug":null,"method_name":"James Lee"},{"method_slug":null,"method_name":"Michael"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"Paramount Plus Login Account"},{"method_slug":null,"method_name":"Priceline Flights from New York to Los Angeles"},{"method_slug":null,"method_name":"QB Setup Help"},{"method_slug":null,"method_name":"QuanTraderX Reviews"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"QuickBooks Installation Windows Installer Issues"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"Quickbooks"},{"method_slug":null,"method_name":"Quickbooks Desktop Subscription"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"RSM"},{"method_slug":null,"method_name":"Report a Problem"},{"method_slug":null,"method_name":"Roadrunner"},{"method_slug":null,"method_name":"Royal Caribbean Cruises"},{"method_slug":null,"method_name":"Salesforce ADX-211 Exam Tips"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"Style Meets Function: Trendy Men's Sports Pants for the Gym"},{"method_slug":null,"method_name":"TAP Air Portugal Phone Support: Key Contact Numbers for Help"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"The Role of a Gastroenterologist: What They Do & How They Can Help"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"Travel"},{"method_slug":null,"method_name":"Travel Support"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"Understanding Uphold’s Rules for Refunds and Reversals"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"Uphold Customer Care: Common Issues and Quick Fixes"},{"method_slug":null,"method_name":"Uphold Support: Phone, Chat & Email Options Explained"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"Ways to Get in Touch with Kucoin Wallet : 12 Easy Contact Methods Explained"},{"method_slug":null,"method_name":"Ways to Get in Touch with Kucoin Wallet : 7 Easy Contact Methods Explained"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"Website Development Services in Mandi House for Every Business"},{"method_slug":null,"method_name":"What information do I give someone to pay me on 𝖛𝖊𝖓𝖒𝖔— Clarify Payment Details for Easy 𝓽𝓻𝓪𝓷𝓼𝓪𝓬𝓽𝓲𝓸𝓷𝓼!"},{"method_slug":null,"method_name":"What is the number for"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"Where is my 𝖜𝖆𝖑𝖑𝖊𝖙on 𝖛𝖊𝖓𝖒𝖔— Locate Your Wallet!"},{"method_slug":null,"method_name":"You Can Contact BellSouth Anytime – Here’s the 24/7 Number You Need"},{"method_slug":null,"method_name":"You Can Contact Roadrunner Anytime – Here’s the 24/7 Number You Need"},{"method_slug":null,"method_name":"You Can Reach BellSouth Anytime – Here’s the 24/7 Number You Need"},{"method_slug":null,"method_name":"You Can Reach Coinme Anytime – Here’s the 24/7 Number You Need"},{"method_slug":null,"method_name":"You Can Reach Moonpay Anytime – Here’s the 24/7 Number You Need"},{"method_slug":null,"method_name":"You Can Reach Roadrunner Support Anytime – Here’s the 24/7 Number You Need"},{"method_slug":null,"method_name":"You Can Reach Trezor Wallet Anytime – Here’s the 24/7 Number You Need"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"acmespineandortho"},{"method_slug":null,"method_name":"avisnourix"},{"method_slug":null,"method_name":"coursework help"},{"method_slug":null,"method_name":"declining Payment"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"hello"},{"method_slug":null,"method_name":"herry"},{"method_slug":null,"method_name":"hey I am new"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"lewo"},{"method_slug":null,"method_name":"live Support"},{"method_slug":null,"method_name":"nourix en pharmacie"},{"method_slug":null,"method_name":"oyegifts22"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"resolve a problem"},{"method_slug":null,"method_name":"supercashdeal Thailand"},{"method_slug":null,"method_name":"top interior fit-out companies in dubai"},{"method_slug":null,"method_name":"transfer Money"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":"Ｈｏｗ ｄｏ Ｉ ａｓｋ ａ ｑｕｅｓｔｉｏｎ ｉｎ Ａｌａｓｋａ？"},{"method_slug":null,"method_name":"𝖛𝖊𝖓𝖒𝖔payment declined there was an issue with your payment"},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null},{"method_slug":null,"method_name":null}],"datasets_introduced":[{"slug":"aolp","name":"AOLP","full_name":"Application-oriented License Plate"},{"slug":"cicids2018","name":"CICIDS2018","full_name":"CSE-CIC-IDS2018 on AWS"},{"slug":"kumar","name":"Kumar","full_name":""},{"slug":"smd","name":"SMD","full_name":"Server Machine Dataset"},{"slug":"d","name":"d","full_name":"d"}],"methods_introduced":[],"results":[{"leaderboard":"/sota/fine-grained-image-classification-on-cub-200-1","task":"Fine-Grained Image Classification","dataset":"CUB-200-2011","model":"IELT","rank_in_archive_order":5,"of":30,"metrics":{"Accuracy":"91.8"},"uses_additional_data":false},{"leaderboard":"/sota/fracture-detection-on-grazpedwri-dx","task":"Fracture detection","dataset":"GRAZPEDWRI-DX","model":"YOLOv5s","rank_in_archive_order":18,"of":19,"metrics":{"Fracture Sensitivity":"91.00"},"uses_additional_data":false},{"leaderboard":"/sota/fracture-detection-on-grazpedwri-dx","task":"Fracture detection","dataset":"GRAZPEDWRI-DX","model":"YOLOv6s","rank_in_archive_order":19,"of":19,"metrics":{"Fracture Sensitivity":"89.00"},"uses_additional_data":false},{"leaderboard":"/sota/graph-classification-on-proteins","task":"Graph Classification","dataset":"PROTEINS","model":"Eff.resistance graph  kernel","rank_in_archive_order":101,"of":103,"metrics":{"Accuracy":"65.7% ± 4.2%"},"uses_additional_data":false},{"leaderboard":"/sota/image-classification-on-imagenet","task":"Image Classification","dataset":"ImageNet","model":"HMAX","rank_in_archive_order":1054,"of":1060,"metrics":{"Top 1 Accuracy":"38.3%"},"uses_additional_data":false},{"leaderboard":"/sota/low-light-image-enhancement-on-lol","task":"Low-Light Image Enhancement","dataset":"LOL","model":"rr","rank_in_archive_order":40,"of":40,"metrics":{"BSQ-rate over MS-SSIM":"0.2"},"uses_additional_data":false},{"leaderboard":"/sota/multimodal-emotion-recognition-on-iemocap-4","task":"Multimodal Emotion Recognition","dataset":"IEMOCAP-4","model":"bc-LSTM","rank_in_archive_order":4,"of":11,"metrics":{"Weighted F1":"74.1"},"uses_additional_data":false},{"leaderboard":"/sota/question-answering-on-multitq","task":"Question Answering","dataset":"MultiTQ","model":"TimeR4","rank_in_archive_order":2,"of":11,"metrics":{"Hits@1":"72.8"},"uses_additional_data":false},{"leaderboard":"/sota/question-answering-on-newsqa","task":"Question Answering","dataset":"NewsQA","model":"OpenAI/o1-2024-12-17-high","rank_in_archive_order":4,"of":18,"metrics":{"EM":"81.44","F1":"88.72"},"uses_additional_data":true},{"leaderboard":"/sota/real-time-object-detection-on-coco","task":"Real-Time Object Detection","dataset":"COCO (Common Objects in Context)","model":"D-FINE-L+","rank_in_archive_order":4,"of":82,"metrics":{"FPS (V100, b=1)":"124 (T4)","box AP":"57.1"},"uses_additional_data":false},{"leaderboard":"/sota/robot-manipulation-generalization-on-the","task":"Robot Manipulation Generalization","dataset":"The COLOSSEUM","model":"RVT","rank_in_archive_order":1,"of":9,"metrics":{"Average decrease average across all perturbations":"-14.5"},"uses_additional_data":false},{"leaderboard":"/sota/text-to-3d-on-t-3-bench","task":"Text to 3D","dataset":"T$^3$Bench","model":"ProlificDreamer","rank_in_archive_order":1,"of":6,"metrics":{"Avg":"43.3"},"uses_additional_data":false},{"leaderboard":"/sota/unsupervised-domain-adaptation-on-office-home","task":"Unsupervised Domain Adaptation","dataset":"Office-Home","model":"DisClusterDA","rank_in_archive_order":20,"of":20,"metrics":{"Average Accuracy":"71.4"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2206.09379","atlas_url":"https://app.syntology.ai/?focus=2206.09379","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}