{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/first-order-manifold-data-augmentation-for","title":"First-Order Manifold Data Augmentation for Regression Learning","arxiv_id":"2406.10914","date":"2024-06-16","proceeding":null,"authors":["Ilya Kaufman","Omri Azencot"],"abstract":"Data augmentation (DA) methods tailored to specific domains generate synthetic samples by applying transformations that are appropriate for the characteristics of the underlying data domain, such as rotations on images and time warping on time series data. In contrast, domain-independent approaches, e.g. mixup, are applicable to various data modalities, and as such they are general and versatile. While regularizing classification tasks via DA is a well-explored research topic, the effect of DA on regression problems received less attention. To bridge this gap, we study the problem of domain-independent augmentation for regression, and we introduce FOMA: a new data-driven domain-independent data augmentation method. Essentially, our approach samples new examples from the tangent planes of the train distribution. Augmenting data in this way aligns with the network tendency towards capturing the dominant features of its input signals. We evaluate FOMA on in-distribution generalization and out-of-distribution robustness benchmarks, and we show that it improves the generalization of several neural architectures. We also find that strong baselines based on mixup are less effective in comparison to our approach. Our code is publicly available athttps://github.com/azencot-group/FOMA.","url_abs":"https://arxiv.org/abs/2406.10914v1","url_pdf":"https://arxiv.org/pdf/2406.10914v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"first-order-manifold-data-augmentation-for","repo_url":"https://github.com/azencot-group/foma","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"data-augmentation","task_name":"Data Augmentation"},{"task_slug":"regression-1","task_name":"regression"}],"methods":[{"method_slug":"mixup","method_name":"Mixup"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2406.10914","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.10914"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/azencot-group/foma","reach":null}],"summary":{"ran_draft_wrong":2,"ran_fixture":4,"ran_honours":2,"unverified":4},"by_repo_kind":{"official":{"samples":12,"ran":8,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"992737ceb00c1e2e","entry":"apply_lambda_after_id_estimation","repo":"azencot-group/foma","repo_kind":"official","path":"src/foma.py","file_url":"https://github.com/azencot-group/foma/blob/HEAD/src/foma.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"992737ceb00c1e2e"}},{"code_sha256_prefix":"69eb4e99ecdf894b","entry":"calculate_lam_mult_by_rho","repo":"azencot-group/foma","repo_kind":"official","path":"src/foma.py","file_url":"https://github.com/azencot-group/foma/blob/HEAD/src/foma.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"69eb4e99ecdf894b"}},{"code_sha256_prefix":"b844e33b3a003151","entry":"estimate","repo":"azencot-group/foma","repo_kind":"official","path":"src/foma.py","file_url":"https://github.com/azencot-group/foma/blob/HEAD/src/foma.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b844e33b3a003151"}},{"code_sha256_prefix":"08c0d2c3e4069924","entry":"estimate_torch","repo":"azencot-group/foma","repo_kind":"official","path":"src/foma.py","file_url":"https://github.com/azencot-group/foma/blob/HEAD/src/foma.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"08c0d2c3e4069924"}},{"code_sha256_prefix":"76a7ba5528c5faed","entry":"estimate_torch_batched","repo":"azencot-group/foma","repo_kind":"official","path":"src/foma.py","file_url":"https://github.com/azencot-group/foma/blob/HEAD/src/foma.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"76a7ba5528c5faed"}},{"code_sha256_prefix":"b028feaa536c72d9","entry":"get_lambda","repo":"azencot-group/foma","repo_kind":"official","path":"src/foma.py","file_url":"https://github.com/azencot-group/foma/blob/HEAD/src/foma.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b028feaa536c72d9"}},{"code_sha256_prefix":"740e41729d6ca30c","entry":"intrinsic_dimension_numpy","repo":"azencot-group/foma","repo_kind":"official","path":"src/foma.py","file_url":"https://github.com/azencot-group/foma/blob/HEAD/src/foma.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"740e41729d6ca30c"}},{"code_sha256_prefix":"e0fc78c1aad9efcf","entry":"reshape_inputs","repo":"azencot-group/foma","repo_kind":"official","path":"src/foma.py","file_url":"https://github.com/azencot-group/foma/blob/HEAD/src/foma.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e0fc78c1aad9efcf"}},{"code_sha256_prefix":"ee365304110b1199","entry":"estimate_intrinsic_dimension","repo":"azencot-group/foma","repo_kind":"official","path":"src/foma.py","file_url":"https://github.com/azencot-group/foma/blob/HEAD/src/foma.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ee365304110b1199"}},{"code_sha256_prefix":"e12761cee59f4395","entry":"intrinsic_dimension","repo":"azencot-group/foma","repo_kind":"official","path":"src/foma.py","file_url":"https://github.com/azencot-group/foma/blob/HEAD/src/foma.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e12761cee59f4395"}},{"code_sha256_prefix":"fc40f4839b659732","entry":"intrinsic_dimension_torch","repo":"azencot-group/foma","repo_kind":"official","path":"src/foma.py","file_url":"https://github.com/azencot-group/foma/blob/HEAD/src/foma.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fc40f4839b659732"}},{"code_sha256_prefix":"6f08048a12865928","entry":"scale_down","repo":"azencot-group/foma","repo_kind":"official","path":"src/foma.py","file_url":"https://github.com/azencot-group/foma/blob/HEAD/src/foma.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6f08048a12865928"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}