{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2604-03779","title":"CountsDiff: A Diffusion Model on the Natural Numbers for Generation and Imputation of Count-Based Data","arxiv_id":"2604.03779","date":"2026-04-04","proceeding":"ICML","authors":["Renzo G. Soatto","Anders Hoel","Greycen Ren","Shorna Alam","Stephen Bates","Nikolaos P. Daskalakis","Caroline Uhler","Maria Skoularidou"],"abstract":"Diffusion models have excelled at generative tasks for both continuous and token-based domains, but their application to discrete ordinal data remains underdeveloped. We present CountsDiff, a diffusion framework designed to model distributions on the natural numbers. CountsDiff extends the Blackout diffusion framework by simplifying its formulation through a direct parameterization in terms of a survival probability schedule and an explicit loss weighting. This introduces flexibility through design parameters with direct analogues in existing diffusion modeling frameworks. Beyond this reparameterization, CountsDiff introduces features from modern diffusion models, previously absent in counts-based domains, including continuous-time training, classifier-free guidance, and churn/remasking reverse dynamics that allow non-monotone reverse trajectories. We propose an initial instantiation of CountsDiff and validate it on natural image datasets (CIFAR-10, CelebA), exploring the effects of the introduced design parameters in a complex, well-studied, and interpretable data domain. We then highlight biological count assays as a natural use case, evaluating CountsDiff on single-cell RNA-seq imputation in fetal and heart cell atlases. Remarkably, we find that even this simple instantiation matches or surpasses the performance of a state-of-the-art discrete generative model and leading scRNA-seq imputation methods, while leaving substantial headroom for further gains through optimized design choices in future work.","url_abs":"https://arxiv.org/abs/2604.03779","url_pdf":"https://arxiv.org/pdf/2604.03779","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2604.03779","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2604.03779"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/rsoatto/countsdiff","reach":null}],"summary":{"unverified":16},"by_repo_kind":{"found_in_text":{"samples":16,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":16,"samples":[{"code_sha256_prefix":"625ede52a28f1d56","entry":"build_legacy_blackout_observation_times","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/training/utils.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/training/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"625ede52a28f1d56"}},{"code_sha256_prefix":"4b688235b7af87a5","entry":"build_sigma_schedule","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/generation/sampling.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/generation/sampling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4b688235b7af87a5"}},{"code_sha256_prefix":"e83261b28f015441","entry":"calculate_jsd","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/utils/metrics.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/utils/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e83261b28f015441"}},{"code_sha256_prefix":"5671fbe8ef6fc6fc","entry":"calculate_mmd","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/utils/metrics.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/utils/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5671fbe8ef6fc6fc"}},{"code_sha256_prefix":"97750580cf3aa989","entry":"calculate_wasserstein_distance","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/utils/metrics.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/utils/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"97750580cf3aa989"}},{"code_sha256_prefix":"c516644266ca796e","entry":"cos_p_scheduler","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/training/utils.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/training/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"c516644266ca796e"}},{"code_sha256_prefix":"52b2934ce18d3f4c","entry":"make_wandb_safe","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/utils/tracking.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/utils/tracking.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"52b2934ce18d3f4c"}},{"code_sha256_prefix":"a95b40012fa4d679","entry":"normalize_config_literals","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/utils/tracking.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/utils/tracking.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a95b40012fa4d679"}},{"code_sha256_prefix":"037a743663696ad7","entry":"positional_encoding","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/generation/sampling.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/generation/sampling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"037a743663696ad7"}},{"code_sha256_prefix":"4c15513791195fcf","entry":"resolve_sigma_schedule","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/generation/sampling.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/generation/sampling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4c15513791195fcf"}},{"code_sha256_prefix":"b4ada36cae00f7c6","entry":"resolved_config_for_run","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/utils/tracking.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/utils/tracking.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b4ada36cae00f7c6"}},{"code_sha256_prefix":"8f2eadcf06e5a9e0","entry":"restore_checkpoint_withEval","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/utils/checkpoints.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/utils/checkpoints.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8f2eadcf06e5a9e0"}},{"code_sha256_prefix":"e0bf82487ce22951","entry":"restore_checkpoint_with_sum","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/utils/checkpoints.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/utils/checkpoints.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"e0bf82487ce22951"}},{"code_sha256_prefix":"cd2b28d29b7a525c","entry":"save_checkpoint_withEval","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/utils/checkpoints.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/utils/checkpoints.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"cd2b28d29b7a525c"}},{"code_sha256_prefix":"047467be88565ffe","entry":"setup_logging","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/utils/logging.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/utils/logging.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"047467be88565ffe"}},{"code_sha256_prefix":"6c96b4bcd031f462","entry":"weight_scheduler","repo":"rsoatto/countsdiff","repo_kind":"found_in_text","path":"src/countsdiff/training/utils.py","file_url":"https://github.com/rsoatto/countsdiff/blob/HEAD/src/countsdiff/training/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"6c96b4bcd031f462"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.LG","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}