{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/low-loss-connection-of-weight-vectors","title":"Low-loss connection of weight vectors: distribution-based approaches","arxiv_id":"2008.00741","date":"2020-08-03","proceeding":"ICML 2020 1","authors":["Ivan Anokhin","Dmitry Yarotsky"],"abstract":"Recent research shows that sublevel sets of the loss surfaces of overparameterized networks are connected, exactly or approximately. We describe and compare experimentally a panel of methods used to connect two low-loss points by a low-loss curve on this surface. Our methods vary in accuracy and complexity. Most of our methods are based on \"macroscopic\" distributional assumptions, and some are insensitive to the detailed properties of the points to be connected. Some methods require a prior training of a \"global connection model\" which can then be applied to any pair of points. The accuracy of the method generally correlates with its complexity and sensitivity to the endpoint detail.","url_abs":"https://arxiv.org/abs/2008.00741v1","url_pdf":"https://arxiv.org/pdf/2008.00741v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"low-loss-connection-of-weight-vectors","repo_url":"https://github.com/avecplezir/distribution-based-connectivity","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"sensitivity","task_name":"Sensitivity"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2008.00741","atlas_url":"https://app.syntology.ai/?focus=2008.00741","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}