{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/optimal-neural-summarisation-for-full-field","title":"Optimal Neural Summarisation for Full-Field Weak Lensing Cosmological Implicit Inference","arxiv_id":"2407.10877","date":"2024-07-15","proceeding":null,"authors":["Denise Lanzieri","Justine Zeghal","T. Lucas Makinen","Alexandre Boucaud","Jean-Luc Starck","François Lanusse"],"abstract":"Traditionally, weak lensing cosmological surveys have been analyzed using summary statistics motivated by their analytically tractable likelihoods, or by their ability to access higher-order information, at the cost of requiring Simulation-Based Inference (SBI) approaches. While informative, these statistics are neither designed nor guaranteed to be statistically sufficient. With the rise of deep learning, it becomes possible to create summary statistics optimized to extract the full data information. We compare different neural summarization strategies proposed in the weak lensing literature, to assess which loss functions lead to theoretically optimal summary statistics to perform full-field inference. In doing so, we aim to provide guidelines and insights to the community to help guide future neural-based inference analyses. We design an experimental setup to isolate the impact of the loss function used to train neural networks. We have developed the sbi_lens JAX package, which implements an automatically differentiable lognormal wCDM LSST-Y10 weak lensing simulator. The explicit full-field posterior obtained using the Hamiltonian Monte Carlo sampler gives us a ground truth to which to compare different compression strategies. We provide theoretical insight into the loss functions used in the literature and show that some do not necessarily lead to sufficient statistics (e.g. Mean Square Error (MSE)), while those motivated by information theory (e.g. Variational Mutual Information Maximization (VMIM)) can. Our numerical experiments confirm these insights and show, in our simulated wCDM scenario, that the Figure of Merit (FoM) of an analysis using neural summaries optimized under VMIM achieves 100% of the reference Omega_c - sigma_8 full-field FoM, while an analysis using neural summaries trained under MSE achieves only 81% of the same reference FoM.","url_abs":"https://arxiv.org/abs/2407.10877v2","url_pdf":"https://arxiv.org/pdf/2407.10877v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"links_only","authors_date_abstract":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license), from the Kaggle arXiv metadata snapshot of 2026-09-12"},"code_links":[{"paper_slug":"optimal-neural-summarisation-for-full-field","repo_url":"https://github.com/differentiableuniverseinitiative/sbi_lens","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"jax","reach":null},{"paper_slug":"optimal-neural-summarisation-for-full-field","repo_url":"https://github.com/dlanzieri/wl_implicit-inference","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"jax","reach":{"status":"ok"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2407.10877","atlas_url":"https://app.syntology.ai/?focus=2407.10877","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2407.10877"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/differentiableuniverseinitiative/sbi_lens","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/dlanzieri/wl_implicit-inference","reach":{"status":"ok"}}],"summary":{"ran_honours":2,"ran_fixture":1},"by_repo_kind":{"official":{"samples":3,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"a9efefbf3744d6b7","entry":"fill_shift_array","repo":"differentiableuniverseinitiative/sbi_lens","repo_kind":"official","path":"sbi_lens/simulator/LogNormal_field.py","file_url":"https://github.com/differentiableuniverseinitiative/sbi_lens/blob/HEAD/sbi_lens/simulator/LogNormal_field.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a9efefbf3744d6b7"}},{"code_sha256_prefix":"237cbd022a3dc60b","entry":"make_power_map","repo":"differentiableuniverseinitiative/sbi_lens","repo_kind":"official","path":"sbi_lens/simulator/LogNormal_field.py","file_url":"https://github.com/differentiableuniverseinitiative/sbi_lens/blob/HEAD/sbi_lens/simulator/LogNormal_field.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"237cbd022a3dc60b"}},{"code_sha256_prefix":"5da744657bdfcbab","entry":"shift_fn","repo":"differentiableuniverseinitiative/sbi_lens","repo_kind":"official","path":"sbi_lens/simulator/LogNormal_field.py","file_url":"https://github.com/differentiableuniverseinitiative/sbi_lens/blob/HEAD/sbi_lens/simulator/LogNormal_field.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5da744657bdfcbab"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}