{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/investigating-the-histogram-loss-in","title":"Investigating the Histogram Loss in Regression","arxiv_id":"2402.13425","date":"2024-02-20","proceeding":null,"authors":["Ehsan Imani","Kai Luedemann","Sam Scholnick-Hughes","Esraa Elelimy","Martha White"],"abstract":"It is becoming increasingly common in regression to train neural networks that model the entire distribution even if only the mean is required for prediction. This additional modeling often comes with performance gain and the reasons behind the improvement are not fully known. This paper investigates a recent approach to regression, the Histogram Loss, which involves learning the conditional distribution of the target variable by minimizing the cross-entropy between a target distribution and a flexible histogram prediction. We design theoretical and empirical analyses to determine why and when this performance gain appears, and how different components of the loss contribute to it. Our results suggest that the benefits of learning distributions in this setup come from improvements in optimization rather than modelling extra information. We then demonstrate the viability of the Histogram Loss in common deep learning applications without a need for costly hyperparameter tuning.","url_abs":"https://arxiv.org/abs/2402.13425v2","url_pdf":"https://arxiv.org/pdf/2402.13425v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"investigating-the-histogram-loss-in","repo_url":"https://github.com/marthawhite/histogram_loss","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok"}}],"tasks":[{"task_slug":"regression-1","task_name":"regression"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2402.13425","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.13425"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/marthawhite/histogram_loss","reach":{"status":"ok"}}],"summary":{"ran":2,"unverified":3},"by_repo_kind":{"official":{"samples":5,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":5,"samples":[{"code_sha256_prefix":"53e974bbf024dada","entry":"transformer","repo":"marthawhite/histogram_loss","repo_kind":"official","path":"time_series/base_models.py","file_url":"https://github.com/marthawhite/histogram_loss/blob/HEAD/time_series/base_models.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"53e974bbf024dada"}},{"code_sha256_prefix":"4495663edf794914","entry":"transformer_encoder","repo":"marthawhite/histogram_loss","repo_kind":"official","path":"time_series/base_models.py","file_url":"https://github.com/marthawhite/histogram_loss/blob/HEAD/time_series/base_models.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4495663edf794914"}},{"code_sha256_prefix":"79cc6a1c8c188fda","entry":"get_dataset","repo":"marthawhite/histogram_loss","repo_kind":"official","path":"atari_prediction/RL_dataset.py","file_url":"https://github.com/marthawhite/histogram_loss/blob/HEAD/atari_prediction/RL_dataset.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"79cc6a1c8c188fda"}},{"code_sha256_prefix":"058003ff7661c942","entry":"get_model","repo":"marthawhite/histogram_loss","repo_kind":"official","path":"age_estimation/base_models.py","file_url":"https://github.com/marthawhite/histogram_loss/blob/HEAD/age_estimation/base_models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"058003ff7661c942"}},{"code_sha256_prefix":"73cb466595c1b1eb","entry":"large_model","repo":"marthawhite/histogram_loss","repo_kind":"official","path":"atari_prediction/base_models.py","file_url":"https://github.com/marthawhite/histogram_loss/blob/HEAD/atari_prediction/base_models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"73cb466595c1b1eb"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}