{"url":"/task/blocking","name":"Blocking","slug":"blocking","description_markdown":"Entity resolution (also known as entity matching, record linkage, or duplicate detection) is the task of finding records that refer to the same real-world entity across different data sources (e.g., data files, books, websites, and databases). (Source: Wikipedia)\r\n\r\n**Blocking** is a crucial step in any entity resolution pipeline because a pair-wise comparison of all records across two data sources is infeasible. \r\nBlocking applies a computationally cheap method to generate a smaller set of candidate record pairs reducing the workload of the matcher.\r\nDuring matching a more expensive pair-wise matcher generates a final set of matching record pairs.\r\n\r\n\r\nSurvey on blocking:\r\n\r\n- [Papadakis et al.: Blocking and Filtering Techniques for Entity Resolution: A Survey](https://dl.acm.org/doi/pdf/10.1145/3377455), 2020.","categories":[{"name":"Natural Language Processing","url":"/area/natural-language-processing"}],"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","slug_source":"archive_url"},"counts":{"papers_tagged":524,"papers_with_code":129,"benchmarks":5,"benchmark_tables_in_archive":5,"benchmark_tables_shown":5,"benchmark_tables_withheld_as_spam":0,"benchmark_definition":"a leaderboard table with at least one row; benchmark_tables_shown also counts the zero-row tables; benchmark_tables_in_archive adds the tables withheld as spam","datasets":3,"subtasks":0,"parent_tasks":1},"benchmarks":[{"leaderboard":"/sota/blocking-on-abt-buy","slug":"blocking-on-abt-buy","dataset":"Abt-Buy","dataset_url":"/dataset/abt-buy","rows_in_archive":6,"metrics":["Candidate Set Size","Recall"],"first_row_in_archive_order":{"model":"Sudowoodo","paper_title":"Sudowoodo: Contrastive Self-supervised Learning for Multi-purpose Data Integration and Preparation","paper_url":"/paper/sudowoodo-contrastive-self-supervised","paper_date":"2022-07-08","arxiv_id":"2207.04122","code_links":[{"title":"megagonlabs/sudowoodo","url":"https://github.com/megagonlabs/sudowoodo"}],"syntology":null}},{"leaderboard":"/sota/blocking-on-amazon-google","slug":"blocking-on-amazon-google","dataset":"Amazon-Google","dataset_url":"/dataset/amazon-google","rows_in_archive":6,"metrics":["Candidate Set Size","Recall"],"first_row_in_archive_order":{"model":"SC-Block","paper_title":"SC-Block: Supervised Contrastive Blocking within Entity Resolution Pipelines","paper_url":"/paper/sc-block-supervised-contrastive-blocking","paper_date":"2023-03-06","arxiv_id":"2303.03132","code_links":[{"title":"wbsg-uni-mannheim/sc-block","url":"https://github.com/wbsg-uni-mannheim/sc-block"}],"syntology":null}},{"leaderboard":"/sota/blocking-on-wdc-block-large","slug":"blocking-on-wdc-block-large","dataset":"WDC Block - large","dataset_url":"/dataset/wdc-block","rows_in_archive":2,"metrics":["Candidate Set Size","Recall"],"first_row_in_archive_order":{"model":"SC-Block","paper_title":"SC-Block: Supervised Contrastive Blocking within Entity Resolution Pipelines","paper_url":"/paper/sc-block-supervised-contrastive-blocking","paper_date":"2023-03-06","arxiv_id":"2303.03132","code_links":[{"title":"wbsg-uni-mannheim/sc-block","url":"https://github.com/wbsg-uni-mannheim/sc-block"}],"syntology":null}},{"leaderboard":"/sota/blocking-on-wdc-block-medium","slug":"blocking-on-wdc-block-medium","dataset":"WDC Block - medium","dataset_url":"/dataset/wdc-block","rows_in_archive":2,"metrics":["Candidate Set Size","Recall"],"first_row_in_archive_order":{"model":"SC-Block","paper_title":"SC-Block: Supervised Contrastive Blocking within Entity Resolution Pipelines","paper_url":"/paper/sc-block-supervised-contrastive-blocking","paper_date":"2023-03-06","arxiv_id":"2303.03132","code_links":[{"title":"wbsg-uni-mannheim/sc-block","url":"https://github.com/wbsg-uni-mannheim/sc-block"}],"syntology":null}},{"leaderboard":"/sota/blocking-on-wdc-block-small","slug":"blocking-on-wdc-block-small","dataset":"WDC Block - small","dataset_url":"/dataset/wdc-block","rows_in_archive":2,"metrics":["Recall","Candidate Set Size"],"first_row_in_archive_order":{"model":"BM25","paper_title":"SC-Block: Supervised Contrastive Blocking within Entity Resolution Pipelines","paper_url":"/paper/sc-block-supervised-contrastive-blocking","paper_date":"2023-03-06","arxiv_id":"2303.03132","code_links":[{"title":"wbsg-uni-mannheim/sc-block","url":"https://github.com/wbsg-uni-mannheim/sc-block"}],"syntology":null}}],"datasets":[{"url":"/dataset/amazon-google","name":"Amazon-Google","full_name":"","num_papers_in_archive":20},{"url":"/dataset/abt-buy","name":"Abt-Buy","full_name":"","num_papers_in_archive":19},{"url":"/dataset/wdc-block","name":"WDC Block","full_name":"WDC Block: A Blocking Benchmark","num_papers_in_archive":1}],"subtasks":[],"parent_tasks":[{"url":"/task/entity-resolution","name":"Entity Resolution"}],"papers":{"order":"repositories listed in the archive (desc), then date (desc); the archive holds no stars","population":"papers tagged with this task that list at least one repository in the archive","shown":30,"of":129,"tagged_in_all":524,"items":[{"url":"/paper/sinet-extreme-lightweight-portrait","title":"SINet: Extreme Lightweight Portrait Segmentation Networks with Spatial Squeeze Modules and Information Blocking Decoder","date":"2019-11-20","arxiv_id":"1911.09099","repositories_listed":8,"syntology":null},{"url":"/paper/neural-text-generation-with-unlikelihood","title":"Neural Text Generation with Unlikelihood Training","date":"2019-08-12","arxiv_id":"1908.04319","repositories_listed":6,"syntology":{"n":6,"n_ran":6,"n_unverified":0,"n_pointer_only":4}},{"url":"/paper/d-blink-distributed-end-to-end-bayesian","title":"d-blink: Distributed End-to-End Bayesian Entity Resolution","date":"2019-09-13","arxiv_id":"1909.06039","repositories_listed":4,"syntology":null},{"url":"/paper/compression-artifacts-reduction-by-a-deep","title":"Compression Artifacts Reduction by a Deep Convolutional Network","date":"2015-04-27","arxiv_id":"1504.06993","repositories_listed":4,"syntology":{"n":12,"n_ran":0,"n_unverified":12,"n_pointer_only":0}},{"url":"/paper/towards-effective-planning-strategies-for","title":"Towards Effective Planning Strategies for Dynamic Opinion Networks","date":"2024-10-18","arxiv_id":"2410.14091","repositories_listed":2,"syntology":{"n":3,"n_ran":3,"n_unverified":0,"n_pointer_only":0}},{"url":"/paper/towards-universal-dense-blocking-for-entity","title":"Towards Universal Dense Blocking for Entity Resolution","date":"2024-04-23","arxiv_id":"2404.14831","repositories_listed":2,"syntology":null},{"url":"/paper/streammultidiffusion-real-time-interactive","title":"SemanticDraw: Towards Real-Time Interactive Content Creation from Image Diffusion Models","date":"2024-03-14","arxiv_id":"2403.09055","repositories_listed":2,"syntology":{"n":5,"n_ran":5,"n_unverified":0,"n_pointer_only":0}},{"url":"/paper/dynamicvit-efficient-vision-transformers-with","title":"DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification","date":"2021-06-03","arxiv_id":"2106.02034","repositories_listed":2,"syntology":{"n":9,"n_ran":6,"n_unverified":3,"n_pointer_only":1}},{"url":"/paper/slowmo-improving-communication-efficient","title":"SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum","date":"2019-10-01","arxiv_id":"1910.00643","repositories_listed":2,"syntology":{"n":3,"n_ran":0,"n_unverified":3,"n_pointer_only":0}},{"url":"/paper/percival-making-in-browser-perceptual-ad","title":"Percival: Making In-Browser Perceptual Ad Blocking Practical With Deep Learning","date":"2019-05-17","arxiv_id":"1905.07444","repositories_listed":2,"syntology":null},{"url":"/paper/emergent-complexity-via-multi-agent","title":"Emergent Complexity via Multi-Agent Competition","date":"2017-10-10","arxiv_id":"1710.03748","repositories_listed":2,"syntology":null},{"url":"/paper/deep-convolution-networks-for-compression","title":"Deep Convolution Networks for Compression Artifacts Reduction","date":"2016-08-09","arxiv_id":"1608.02778","repositories_listed":2,"syntology":null},{"url":"/paper/noloco-no-all-reduce-low-communication","title":"NoLoCo: No-all-reduce Low Communication Training Method for Large Models","date":"2025-06-12","arxiv_id":"2506.10911","repositories_listed":1,"syntology":null},{"url":"/paper/2506-10660","title":"Pushing the Limits of Extreme Weather: Constructing Extreme Heatwave Storylines with Differentiable Climate Models","date":"2025-06-12","arxiv_id":"2506.10660","repositories_listed":1,"syntology":null},{"url":"/paper/open-captchaworld-a-comprehensive-web-based","title":"Open CaptchaWorld: A Comprehensive Web-based Platform for Testing and Benchmarking Multimodal LLM Agents","date":"2025-05-30","arxiv_id":"2505.24878","repositories_listed":1,"syntology":null},{"url":"/paper/progent-programmable-privilege-control-for","title":"Progent: Programmable Privilege Control for LLM Agents","date":"2025-04-16","arxiv_id":"2504.11703","repositories_listed":1,"syntology":null},{"url":"/paper/deep-learning-meets-teleconnections-improving","title":"Deep Learning Meets Teleconnections: Improving S2S Predictions for European Winter Weather","date":"2025-04-10","arxiv_id":"2504.07625","repositories_listed":1,"syntology":null},{"url":"/paper/corba-contagious-recursive-blocking-attacks","title":"CORBA: Contagious Recursive Blocking Attacks on Multi-Agent Systems Based on Large Language Models","date":"2025-02-20","arxiv_id":"2502.14529","repositories_listed":1,"syntology":null},{"url":"/paper/reinforcement-learning-for-dynamic-resource-1","title":"Reinforcement Learning for Dynamic Resource Allocation in Optical Networks: Hype or Hope?","date":"2025-02-18","arxiv_id":"2502.12804","repositories_listed":1,"syntology":null},{"url":"/paper/linking-cryptoasset-attribution-tags-to","title":"Linking Cryptoasset Attribution Tags to Knowledge Graph Entities: An LLM-based Approach","date":"2025-02-12","arxiv_id":"2502.10453","repositories_listed":1,"syntology":null},{"url":"/paper/diffim-differentiable-influence-minimization","title":"DiffIM: Differentiable Influence Minimization with Surrogate Modeling and Continuous Relaxation","date":"2025-02-03","arxiv_id":"2502.01031","repositories_listed":1,"syntology":null},{"url":"/paper/foundation-for-unbiased-cross-validation-of","title":"Foundation for unbiased cross-validation of spatio-temporal models for species distribution modeling","date":"2025-01-27","arxiv_id":"2502.03480","repositories_listed":1,"syntology":null},{"url":"/paper/gandalf-the-red-adaptive-security-for-llms","title":"Gandalf the Red: Adaptive Security for LLMs","date":"2025-01-14","arxiv_id":"2501.07927","repositories_listed":1,"syntology":null},{"url":"/paper/fully-stochastic-primal-dual-gradient","title":"A Stochastic Approximation Approach for Efficient Decentralized Optimization on Random Networks","date":"2024-10-24","arxiv_id":"2410.18774","repositories_listed":1,"syntology":null},{"url":"/paper/on-calibration-of-llm-based-guard-models-for","title":"On Calibration of LLM-based Guard Models for Reliable Content Moderation","date":"2024-10-14","arxiv_id":"2410.10414","repositories_listed":1,"syntology":{"n":6,"n_ran":4,"n_unverified":2,"n_pointer_only":0}},{"url":"/paper/multi-granularity-contrastive-cross-modal","title":"Multi-granularity Contrastive Cross-modal Collaborative Generation for End-to-End Long-term Video Question Answering","date":"2024-10-12","arxiv_id":"2410.09379","repositories_listed":1,"syntology":null},{"url":"/paper/evaluating-blocking-biases-in-entity-matching","title":"Evaluating Blocking Biases in Entity Matching","date":"2024-09-24","arxiv_id":"2409.16410","repositories_listed":1,"syntology":null},{"url":"/paper/not-all-videos-become-outdated-short-video","title":"Not All Videos Become Outdated: Short-Video Recommendation by Learning to Deconfound Release Interval Bias","date":"2024-08-30","arxiv_id":"2408.17332","repositories_listed":1,"syntology":null},{"url":"/paper/efficient-llm-scheduling-by-learning-to-rank","title":"Efficient LLM Scheduling by Learning to Rank","date":"2024-08-28","arxiv_id":"2408.15792","repositories_listed":1,"syntology":{"n":3,"n_ran":0,"n_unverified":3,"n_pointer_only":0}},{"url":"/paper/surgical-workflow-recognition-and-blocking","title":"Surgical Workflow Recognition and Blocking Effectiveness Detection in Laparoscopic Liver Resections with Pringle Maneuver","date":"2024-08-20","arxiv_id":"2408.10538","repositories_listed":1,"syntology":null}],"syntology_records":8,"syntology_note":"a paper without a record is not a recorded non-run: it may lack an arXiv id or simply be absent from the graph layer"},"description_links":{"kept":0,"unwrapped_to_text":0,"bare_urls_linked":0,"relative_images_dropped":0,"rule":"internal links are kept only when the target slug exists in the catalog"},"syntology":{"read_at":"2026-09-24T18:15:14+00:00","claim":"Per-sample execution status on synthesized fixtures ('ran N of M samples'); not a correctness claim and not a ranking signal.","status_vocabulary":{"ran_honours":"ran, honoured the contract we drafted","ran_violates":"ran, violated the contract we drafted","ran_draft_wrong":"ran; our contract draft was wrong, not the code","ran_fixture":"ran; our fixture could not drive it","ran":"ran on a synthesized input","unverified":"unverified (harvested, no recorded run)"}},"not_shown":{"libraries":"the archive has no per-task library table","trend_sparklines":"the Trend column of the benchmarks table was a rendered image; it is not in the archive","social_and_latest_sorts":"stars and social signals are not in the archive"}}