{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/laion-5b-an-open-large-scale-dataset-for-1","title":"LAION-5B: An open large-scale dataset for training next generation image-text models","arxiv_id":"2210.08402","date":"2022-10-16","proceeding":"NeurIPS 2022 Datasets and Benchmarks 2022 6","authors":["Christoph Schuhmann","Romain Beaumont","Richard Vencu","Cade Gordon","Ross Wightman","Mehdi Cherti","Theo Coombes","Aarush Katta","Clayton Mullis","Mitchell Wortsman","Patrick Schramowski","Srivatsa Kundurthy","Katherine Crowson","Ludwig Schmidt","Robert Kaczmarczyk","Jenia Jitsev"],"abstract":"Groundbreaking language-vision architectures like CLIP and DALL-E proved the utility of training on large amounts of noisy image-text data, without relying on expensive accurate labels used in standard vision unimodal supervised learning. The resulting models showed capabilities of strong text-guided image generation and transfer to downstream tasks, while performing remarkably at zero-shot classification with noteworthy out-of-distribution robustness. Since then, large-scale language-vision models like ALIGN, BASIC, GLIDE, Flamingo and Imagen made further improvements. Studying the training and capabilities of such models requires datasets containing billions of image-text pairs. Until now, no datasets of this size have been made openly available for the broader research community. To address this problem and democratize research on large-scale multi-modal models, we present LAION-5B - a dataset consisting of 5.85 billion CLIP-filtered image-text pairs, of which 2.32B contain English language. We show successful replication and fine-tuning of foundational models like CLIP, GLIDE and Stable Diffusion using the dataset, and discuss further experiments enabled with an openly available dataset of this scale. Additionally we provide several nearest neighbor indices, an improved web-interface for dataset exploration and subset generation, and detection scores for watermark, NSFW, and toxic content detection. Announcement page https://laion.ai/laion-5b-a-new-era-of-open-large-scale-multi-modal-datasets/","url_abs":"https://arxiv.org/abs/2210.08402v1","url_pdf":"https://arxiv.org/pdf/2210.08402v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"laion-5b-an-open-large-scale-dataset-for-1","repo_url":"https://github.com/mlfoundations/open_clip","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"laion-5b-an-open-large-scale-dataset-for-1","repo_url":"https://github.com/eify/open_clip","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"laion-5b-an-open-large-scale-dataset-for-1","repo_url":"https://github.com/facebookresearch/metaclip","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"laion-5b-an-open-large-scale-dataset-for-1","repo_url":"https://github.com/nahidalam/open_clip","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"laion-5b-an-open-large-scale-dataset-for-1","repo_url":"https://github.com/shkarupa-alex/tfclip","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"preference-mapping","task_name":"Preference Mapping"},{"task_slug":"zero-shot-learning","task_name":"Zero-Shot Learning"},{"task_slug":null,"task_name":"zero-shot-classification"}],"methods":[{"method_slug":"align","method_name":"ALIGN"},{"method_slug":"clip","method_name":"CLIP"},{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"glide","method_name":"GLIDE"}],"datasets_introduced":[{"slug":"laion-5b","name":"LAION-5B","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2210.08402","atlas_url":"https://app.syntology.ai/?focus=2210.08402","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.08402"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/LAION-AI/LAION-5B","reach":{"status":"gone","observed_at":"2026-09-17","how":"tree_404+repo_404"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/LAION-AI/CLIP-based-NSFW-Detector","reach":{"status":"ok","spdx":"NOASSERTION"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/rvencu/crawlingathome-gpu-hcloud","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/rom1504/img2dataset","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/rom1504/clip-retrieval","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/rom1504/laion-prepro","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mlfoundations/open_clip","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/facebookresearch/metaclip","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/eify/open_clip","reach":{"status":"ok","spdx":"NOASSERTION"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/shkarupa-alex/tfclip","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/nahidalam/open_clip","reach":{"status":"ok","spdx":"NOASSERTION"}}],"summary":{"ran":11,"ran_violates":1,"ran_draft_wrong":2,"unverified":4},"by_repo_kind":{"found_in_text":{"samples":15,"ran":11,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"6b0f6ffaf5450f20","entry":"config","repo":"rvencu/crawlingathome-gpu-hcloud","repo_kind":"found_in_text","path":"gpu_inference.py","file_url":"https://github.com/rvencu/crawlingathome-gpu-hcloud/blob/HEAD/gpu_inference.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6b0f6ffaf5450f20"}},{"code_sha256_prefix":"19fb2294a9c2a40c","entry":"config","repo":"rvencu/crawlingathome-gpu-hcloud","repo_kind":"found_in_text","path":"ccpp.py","file_url":"https://github.com/rvencu/crawlingathome-gpu-hcloud/blob/HEAD/ccpp.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"19fb2294a9c2a40c"}},{"code_sha256_prefix":"f19962ebb134b3d7","entry":"convert_to_custom_text_state_dict","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"f19962ebb134b3d7"}},{"code_sha256_prefix":"5857f996a53e3d10","entry":"count_samples","repo":"rom1504/clip-retrieval","repo_kind":"found_in_text","path":"clip_retrieval/clip_back_prepro/parquet_to_arrow.py","file_url":"https://github.com/rom1504/clip-retrieval/blob/HEAD/clip_retrieval/clip_back_prepro/parquet_to_arrow.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5857f996a53e3d10"}},{"code_sha256_prefix":"aad8a39d981e52e6","entry":"df_clipfilter","repo":"rvencu/crawlingathome-gpu-hcloud","repo_kind":"found_in_text","path":"gpu_inference.py","file_url":"https://github.com/rvencu/crawlingathome-gpu-hcloud/blob/HEAD/gpu_inference.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"aad8a39d981e52e6"}},{"code_sha256_prefix":"54a08251b7e05489","entry":"file_to_count","repo":"rom1504/clip-retrieval","repo_kind":"found_in_text","path":"clip_retrieval/clip_back_prepro/parquet_to_arrow.py","file_url":"https://github.com/rom1504/clip-retrieval/blob/HEAD/clip_retrieval/clip_back_prepro/parquet_to_arrow.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"54a08251b7e05489"}},{"code_sha256_prefix":"0f5ca6c21457febb","entry":"filter","repo":"rvencu/crawlingathome-gpu-hcloud","repo_kind":"found_in_text","path":"gpu_inference.py","file_url":"https://github.com/rvencu/crawlingathome-gpu-hcloud/blob/HEAD/gpu_inference.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0f5ca6c21457febb"}},{"code_sha256_prefix":"dcd422d66b0581d8","entry":"get_cast_dtype","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"dcd422d66b0581d8"}},{"code_sha256_prefix":"b476c8cfbf0f1f47","entry":"get_input_dtype","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":null,"inline_ok":false,"mcp_get_code":{"code_sha256":"b476c8cfbf0f1f47"}},{"code_sha256_prefix":"42824ddb4bfbec48","entry":"metric_to_average","repo":"rom1504/clip-retrieval","repo_kind":"found_in_text","path":"clip_retrieval/clip_back.py","file_url":"https://github.com/rom1504/clip-retrieval/blob/HEAD/clip_retrieval/clip_back.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"42824ddb4bfbec48"}},{"code_sha256_prefix":"a824d70f7658bab0","entry":"move_files_to_folders","repo":"rvencu/crawlingathome-gpu-hcloud","repo_kind":"found_in_text","path":"postCLIP_staging/movefiles.py","file_url":"https://github.com/rvencu/crawlingathome-gpu-hcloud/blob/HEAD/postCLIP_staging/movefiles.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a824d70f7658bab0"}},{"code_sha256_prefix":"1472ce0e9f26f1c7","entry":"normalized","repo":"rom1504/clip-retrieval","repo_kind":"found_in_text","path":"clip_retrieval/clip_back.py","file_url":"https://github.com/rom1504/clip-retrieval/blob/HEAD/clip_retrieval/clip_back.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1472ce0e9f26f1c7"}},{"code_sha256_prefix":"68deb34ae97e2fa1","entry":"process_img_content","repo":"rvencu/crawlingathome-gpu-hcloud","repo_kind":"found_in_text","path":"dbdl.py","file_url":"https://github.com/rvencu/crawlingathome-gpu-hcloud/blob/HEAD/dbdl.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"68deb34ae97e2fa1"}},{"code_sha256_prefix":"a487a6f248dc7148","entry":"remove_bad_chars","repo":"rvencu/crawlingathome-gpu-hcloud","repo_kind":"found_in_text","path":"ccpp.py","file_url":"https://github.com/rvencu/crawlingathome-gpu-hcloud/blob/HEAD/ccpp.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a487a6f248dc7148"}},{"code_sha256_prefix":"e47c15572e3af93b","entry":"create_file_list","repo":"rvencu/crawlingathome-gpu-hcloud","repo_kind":"found_in_text","path":"postCLIP_staging/movefiles.py","file_url":"https://github.com/rvencu/crawlingathome-gpu-hcloud/blob/HEAD/postCLIP_staging/movefiles.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e47c15572e3af93b"}},{"code_sha256_prefix":"ef049563c3046681","entry":"download_image","repo":"rom1504/clip-retrieval","repo_kind":"found_in_text","path":"clip_retrieval/clip_back.py","file_url":"https://github.com/rom1504/clip-retrieval/blob/HEAD/clip_retrieval/clip_back.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ef049563c3046681"}},{"code_sha256_prefix":"5261e2f4314f6275","entry":"get_old_to_new_mapping","repo":"rom1504/clip-retrieval","repo_kind":"found_in_text","path":"clip_retrieval/ivf_metadata_ordering.py","file_url":"https://github.com/rom1504/clip-retrieval/blob/HEAD/clip_retrieval/ivf_metadata_ordering.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5261e2f4314f6275"}},{"code_sha256_prefix":"c315c90997b8fc3c","entry":"search_to_new_ids","repo":"rom1504/clip-retrieval","repo_kind":"found_in_text","path":"clip_retrieval/ivf_metadata_ordering.py","file_url":"https://github.com/rom1504/clip-retrieval/blob/HEAD/clip_retrieval/ivf_metadata_ordering.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c315c90997b8fc3c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}