{"url":"/method/dropout","slug":"dropout","name":"Dropout","full_name":"Dropout","full_name_withheld":false,"description_markdown":"**Dropout** is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is $p=0.5$). At test time, all units are present, but with weights scaled by $p$ (i.e. $w$ becomes $pw$).\r\n\r\nThe idea is to prevent co-adaptation, where the neural network becomes too reliant on particular connections, as this could be symptomatic of overfitting. Intuitively, dropout can be thought of as creating an implicit ensemble of neural networks.","description_state":"present","introduced_year":null,"introduced_by":{"title":"Dropout: A Simple Way to Prevent Neural Networks from Overfitting","paper":"/paper/dropout-a-simple-way-to-prevent-neural","first_author":"Nitish Srivastava","n_authors":5,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/dropout-a-simple-way-to-prevent-neural"},"source":{"url":"http://jmlr.org/papers/v15/srivastava14a.html","title":"Dropout: A Simple Way to Prevent Neural Networks from Overfitting","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/google/jax/blob/7f3078b70d0ed9bea6228efa420879c56f72ef69/jax/experimental/stax.py#L271-L275","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Regularization","url":"/methods/category/regularization","pwc_aliases":[]}],"n_papers_tagged":27472,"archive_num_papers":27477,"papers_newest_first":[{"paper":null,"title":"DASViT: Differentiable Architecture Search for Vision Transformer","date":"2025-07-17","arxiv_id":"2507.13079","n_code_links":0,"syntology":null},{"paper":"/paper/making-language-model-a-hierarchical","title":"Making Language Model a Hierarchical Classifier and Generator","date":"2025-07-17","arxiv_id":"2507.12930","n_code_links":1,"syntology":null},{"paper":"/paper/best-practices-for-large-scale-pixel-wise","title":"Best Practices for Large-Scale, Pixel-Wise Crop Mapping and Transfer Learning Workflows","date":"2025-07-16","arxiv_id":"2507.12590","n_code_links":1,"syntology":null},{"paper":"/paper/developing-visual-augmented-q-a-system-using","title":"Developing Visual Augmented Q&A System using Scalable Vision Embedding Retrieval & Late Interaction Re-ranker","date":"2025-07-16","arxiv_id":"2507.12378","n_code_links":1,"syntology":null},{"paper":"/paper/dvfl-net-a-lightweight-distilled-video-focal","title":"DVFL-Net: A Lightweight Distilled Video Focal Modulation Network for Spatio-Temporal Action Recognition","date":"2025-07-16","arxiv_id":"2507.12426","n_code_links":1,"syntology":null},{"paper":"/paper/addressing-data-imbalance-in-transformer","title":"Addressing Data Imbalance in Transformer-Based Multi-Label Emotion Detection with Weighted Loss","date":"2025-07-15","arxiv_id":"2507.11384","n_code_links":1,"syntology":null},{"paper":null,"title":"Biological Processing Units: Leveraging an Insect Connectome to Pioneer Biofidelic Neural Architectures","date":"2025-07-15","arxiv_id":"2507.10951","n_code_links":0,"syntology":null},{"paper":null,"title":"Generative Click-through Rate Prediction with Applications to Search Advertising","date":"2025-07-15","arxiv_id":"2507.11246","n_code_links":0,"syntology":null},{"paper":null,"title":"HANS-Net: Hyperbolic Convolution and Adaptive Temporal Attention for Accurate and Generalizable Liver and Tumor Segmentation in CT Imaging","date":"2025-07-15","arxiv_id":"2507.11325","n_code_links":0,"syntology":null},{"paper":"/paper/hashed-watermark-as-a-filter-defeating","title":"Hashed Watermark as a Filter: Defeating Forging and Overwriting Attacks in Weight-based Neural Network Watermarking","date":"2025-07-15","arxiv_id":"2507.11137","n_code_links":1,"syntology":null},{"paper":"/paper/kv-latent-dimensional-level-kv-cache","title":"KV-Latent: Dimensional-level KV Cache Reduction with Frequency-aware Rotary Positional Embedding","date":"2025-07-15","arxiv_id":"2507.11273","n_code_links":1,"syntology":{"ran":1,"of":1,"unverified":0,"pointer_only":1}},{"paper":"/paper/langevin-flows-for-modeling-neural-latent","title":"Langevin Flows for Modeling Neural Latent Dynamics","date":"2025-07-15","arxiv_id":"2507.11531","n_code_links":1,"syntology":null},{"paper":null,"title":"LiLM-RDB-SFC: Lightweight Language Model with Relational Database-Guided DRL for Optimized SFC Provisioning","date":"2025-07-15","arxiv_id":"2507.10903","n_code_links":0,"syntology":null},{"paper":"/paper/a-simple-approximate-bayesian-inference","title":"A Simple Approximate Bayesian Inference Neural Surrogate for Stochastic Petri Net Models","date":"2025-07-14","arxiv_id":"2507.10714","n_code_links":1,"syntology":null},{"paper":null,"title":"Efficient Federated Learning with Heterogeneous Data and Adaptive Dropout","date":"2025-07-14","arxiv_id":"2507.10430","n_code_links":0,"syntology":null},{"paper":null,"title":"Leveraging RAG-LLMs for Urban Mobility Simulation and Analysis","date":"2025-07-14","arxiv_id":"2507.10382","n_code_links":0,"syntology":null},{"paper":null,"title":"Overcoming catastrophic forgetting in neural networks","date":"2025-07-14","arxiv_id":"2507.10485","n_code_links":0,"syntology":null},{"paper":null,"title":"SentiDrop: A Multi Modal Machine Learning model for Predicting Dropout in Distance Learning","date":"2025-07-14","arxiv_id":"2507.10421","n_code_links":0,"syntology":null},{"paper":null,"title":"Token Compression Meets Compact Vision Transformers: A Survey and Comparative Evaluation for Edge AI","date":"2025-07-13","arxiv_id":"2507.09702","n_code_links":0,"syntology":null},{"paper":null,"title":"Learning from Synthetic Labs: Language Models as Auction Participants","date":"2025-07-12","arxiv_id":"2507.09083","n_code_links":0,"syntology":null},{"paper":null,"title":"Comparative Analysis of Vision Transformers and Traditional Deep Learning Approaches for Automated Pneumonia Detection in Chest X-Rays","date":"2025-07-11","arxiv_id":"2507.10589","n_code_links":0,"syntology":null},{"paper":null,"title":"A statistical physics framework for optimal learning","date":"2025-07-10","arxiv_id":"2507.07907","n_code_links":0,"syntology":null},{"paper":"/paper/orchestrator-agent-trust-a-modular-agentic-ai","title":"Orchestrator-Agent Trust: A Modular Agentic AI Visual Classification System with Trust-Aware Orchestration and RAG-Based Reasoning","date":"2025-07-09","arxiv_id":"2507.10571","n_code_links":1,"syntology":null},{"paper":null,"title":"The Dark Side of LLMs Agent-based Attacks for Complete Computer Takeover","date":"2025-07-09","arxiv_id":"2507.06850","n_code_links":0,"syntology":null},{"paper":null,"title":"A Wireless Foundation Model for Multi-Task Prediction","date":"2025-07-08","arxiv_id":"2507.05938","n_code_links":0,"syntology":null},{"paper":"/paper/agent-kb-leveraging-cross-domain-experience","title":"Agent KB: Leveraging Cross-Domain Experience for Agentic Problem Solving","date":"2025-07-08","arxiv_id":"2507.06229","n_code_links":1,"syntology":{"ran":1,"of":1,"unverified":0,"pointer_only":0}},{"paper":null,"title":"Chat-Ghosting: A Comparative Study of Methods for Auto-Completion in Dialog Systems","date":"2025-07-08","arxiv_id":"2507.05940","n_code_links":0,"syntology":null},{"paper":"/paper/event-rgb-fusion-for-spacecraft-pose","title":"Event-RGB Fusion for Spacecraft Pose Estimation Under Harsh Lighting","date":"2025-07-08","arxiv_id":"2507.05698","n_code_links":1,"syntology":null},{"paper":null,"title":"Geo-Registration of Terrestrial LiDAR Point Clouds with Satellite Images without GNSS","date":"2025-07-08","arxiv_id":"2507.05999","n_code_links":0,"syntology":null},{"paper":"/paper/growing-transformers-modular-composition-and","title":"Growing Transformers: Modular Composition and Layer-wise Expansion on a Frozen Substrate","date":"2025-07-08","arxiv_id":"2507.07129","n_code_links":1,"syntology":null}],"papers_shown":30,"tasks":[{"task":"/task/language-modelling","name":"Language Modelling","papers":3032},{"task":"/task/language-modeling","name":"Language Modeling","papers":2374},{"task":"/task/retrieval","name":"Retrieval","papers":1822},{"task":"/task/question-answering","name":"Question Answering","papers":1494},{"task":"/task/decoder","name":"Decoder","papers":1416},{"task":"/task/sentence","name":"Sentence","papers":1364},{"task":"/task/rag","name":"RAG","papers":1363},{"task":"/task/retrieval-augmented-generation","name":"Retrieval-augmented Generation","papers":1181},{"task":"/task/translation","name":"Translation","papers":1106},{"task":"/task/image-classification","name":"Image Classification","papers":1001},{"task":"/task/machine-translation","name":"Machine Translation","papers":953},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":874},{"task":"/task/semantic-segmentation","name":"Semantic Segmentation","papers":871},{"task":"/task/large-language-model","name":"Large Language Model","papers":838},{"task":"/task/image-classification","name":"image-classification","papers":791},{"task":"/task/classification-1","name":"Classification","papers":784},{"task":"/task/text-generation","name":"Text Generation","papers":767},{"task":"/task/object-detection","name":"Object Detection","papers":743},{"task":"/task/object-detection-1","name":"object-detection","papers":662},{"task":"/task/representation-learning","name":"Representation Learning","papers":661}],"tasks_shown":20,"n_tasks":2664,"usage_by_year":[{"year":"2014","papers":24},{"year":"2015","papers":78},{"year":"2016","papers":121},{"year":"2017","papers":211},{"year":"2018","papers":469},{"year":"2019","papers":1480},{"year":"2020","papers":2645},{"year":"2021","papers":3617},{"year":"2022","papers":3539},{"year":"2023","papers":5366},{"year":"2024","papers":7070},{"year":"2025","papers":2852}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/dropout"},"syntology_read_at":"2026-09-24T18:15:14+00:00"}