{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/measurement-noise-scaling-laws-for-cellular","title":"Measurement noise scaling laws for cellular representation learning","arxiv_id":"2503.02726","date":"2025-03-04","proceeding":null,"authors":["Gokul Gowri","Peng Yin","Allon M. Klein"],"abstract":"Deep learning scaling laws predict how performance improves with increased model and dataset size. Here we identify measurement noise in data as another performance scaling axis, governed by a distinct logarithmic law. We focus on representation learning models of biological single cell genomic data, where a dominant source of measurement noise is due to molecular undersampling. We introduce an information-theoretic metric for cellular representation model quality, and find that it scales with sampling depth. A single quantitative relationship holds across several model types and across several datasets. We show that the analytical form of this relationship can be derived from a simple Gaussian noise model, which in turn provides an intuitive interpretation for the scaling law. Finally, we show that the same relationship emerges in image classification models with respect to two types of imaging noise, suggesting that measurement noise scaling may be a general phenomenon. Scaling with noise can serve as a guide in generating and curating data for deep learning models, particularly in fields where measurement quality can vary dramatically between datasets.","url_abs":"https://arxiv.org/abs/2503.02726v1","url_pdf":"https://arxiv.org/pdf/2503.02726v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"measurement-noise-scaling-laws-for-cellular","repo_url":"https://github.com/ggdna/scScaling","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2503.02726","atlas_url":"https://app.syntology.ai/?focus=2503.02726","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.02726"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ggdna/scScaling","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":2,"unverified":4},"by_repo_kind":{"official":{"samples":6,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"796c47ba077dbda9","entry":"add_noise","repo":"ggdna/scScaling","repo_kind":"official","path":"analysis/latentmi/ksg.py","file_url":"https://github.com/ggdna/scScaling/blob/HEAD/analysis/latentmi/ksg.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"796c47ba077dbda9"}},{"code_sha256_prefix":"062af94f950dd8cc","entry":"query_neighbors","repo":"ggdna/scScaling","repo_kind":"official","path":"analysis/latentmi/ksg.py","file_url":"https://github.com/ggdna/scScaling/blob/HEAD/analysis/latentmi/ksg.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"062af94f950dd8cc"}},{"code_sha256_prefix":"d3e9903c84852fec","entry":"count_neighbors","repo":"ggdna/scScaling","repo_kind":"official","path":"analysis/latentmi/ksg.py","file_url":"https://github.com/ggdna/scScaling/blob/HEAD/analysis/latentmi/ksg.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d3e9903c84852fec"}},{"code_sha256_prefix":"7b7ad78a9ffbfafd","entry":"estimate","repo":"ggdna/scScaling","repo_kind":"official","path":"analysis/latentmi/lmi.py","file_url":"https://github.com/ggdna/scScaling/blob/HEAD/analysis/latentmi/lmi.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7b7ad78a9ffbfafd"}},{"code_sha256_prefix":"a55cedbed7a78a7f","entry":"learn_representation","repo":"ggdna/scScaling","repo_kind":"official","path":"analysis/latentmi/lmi.py","file_url":"https://github.com/ggdna/scScaling/blob/HEAD/analysis/latentmi/lmi.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a55cedbed7a78a7f"}},{"code_sha256_prefix":"1554819853a01883","entry":"split_ad","repo":"ggdna/scScaling","repo_kind":"official","path":"embeddings/data_utils.py","file_url":"https://github.com/ggdna/scScaling/blob/HEAD/embeddings/data_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1554819853a01883"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}