{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/transformer-meets-boundary-value-inverse","title":"Transformer Meets Boundary Value Inverse Problems","arxiv_id":"2209.14977","date":"2022-09-29","proceeding":null,"authors":["Ruchi Guo","Shuhao Cao","Long Chen"],"abstract":"A Transformer-based deep direct sampling method is proposed for electrical impedance tomography, a well-known severely ill-posed nonlinear boundary value inverse problem. A real-time reconstruction is achieved by evaluating the learned inverse operator between carefully designed data and the reconstructed images. An effort is made to give a specific example to a fundamental question: whether and how one can benefit from the theoretical structure of a mathematical problem to develop task-oriented and structure-conforming deep neural networks? Specifically, inspired by direct sampling methods for inverse problems, the 1D boundary data in different frequencies are preprocessed by a partial differential equation-based feature map to yield 2D harmonic extensions as different input channels. Then, by introducing learnable non-local kernels, the direct sampling is recast to a modified attention mechanism. The new method achieves superior accuracy over its predecessors and contemporary operator learners and shows robustness to noises in benchmarks. This research shall strengthen the insights that, despite being invented for natural language processing tasks, the attention mechanism offers great flexibility to be modified in conformity with the a priori mathematical knowledge, which ultimately leads to the design of more physics-compatible neural architectures.","url_abs":"https://arxiv.org/abs/2209.14977v4","url_pdf":"https://arxiv.org/pdf/2209.14977v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"transformer-meets-boundary-value-inverse","repo_url":"https://github.com/scaomath/eit-transformer","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-meets-boundary-value-inverse","repo_url":"https://github.com/zenki229/aais_pinn","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-meets-boundary-value-inverse","repo_url":"https://github.com/zenki229/tmcfpinn","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2209.14977","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2209.14977"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zenki229/aais_pinn","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/scaomath/eit-transformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zenki229/tmcfpinn","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":6,"unverified":12},"by_repo_kind":{"official":{"samples":12,"ran":5,"repositories":1},"listed":{"samples":6,"ran":1,"repositories":2}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"cc18719516f10d04","entry":"BasicBlock","repo":"scaomath/eit-transformer","repo_kind":"official","path":"libs/hut.py","file_url":"https://github.com/scaomath/eit-transformer/blob/HEAD/libs/hut.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cc18719516f10d04"}},{"code_sha256_prefix":"24a9a41f13af71f1","entry":"BottleneckBlock","repo":"scaomath/eit-transformer","repo_kind":"official","path":"libs/hut.py","file_url":"https://github.com/scaomath/eit-transformer/blob/HEAD/libs/hut.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"24a9a41f13af71f1"}},{"code_sha256_prefix":"30e6196656eb2ec7","entry":"DeepNeuralNet","repo":"zenki229/aais_pinn","repo_kind":"listed","path":"libs/deep_neural_net.py","file_url":"https://github.com/zenki229/aais_pinn/blob/HEAD/libs/deep_neural_net.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"30e6196656eb2ec7"}},{"code_sha256_prefix":"6dfbfb40a3f1069b","entry":"RelativePositionBias","repo":"scaomath/eit-transformer","repo_kind":"official","path":"libs/hut.py","file_url":"https://github.com/scaomath/eit-transformer/blob/HEAD/libs/hut.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6dfbfb40a3f1069b"}},{"code_sha256_prefix":"cce566136eb91588","entry":"down_block","repo":"scaomath/eit-transformer","repo_kind":"official","path":"libs/hut.py","file_url":"https://github.com/scaomath/eit-transformer/blob/HEAD/libs/hut.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"cce566136eb91588"}},{"code_sha256_prefix":"8caf576fea0ddaef","entry":"up_block","repo":"scaomath/eit-transformer","repo_kind":"official","path":"libs/hut.py","file_url":"https://github.com/scaomath/eit-transformer/blob/HEAD/libs/hut.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"8caf576fea0ddaef"}},{"code_sha256_prefix":"04fb07399a8c0557","entry":"BasicTransBlock","repo":"scaomath/eit-transformer","repo_kind":"official","path":"libs/hut.py","file_url":"https://github.com/scaomath/eit-transformer/blob/HEAD/libs/hut.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"04fb07399a8c0557"}},{"code_sha256_prefix":"1867fed83e7549a9","entry":"BasicTransDecoderBlock","repo":"scaomath/eit-transformer","repo_kind":"official","path":"libs/hut.py","file_url":"https://github.com/scaomath/eit-transformer/blob/HEAD/libs/hut.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1867fed83e7549a9"}},{"code_sha256_prefix":"73192eb40023eb4e","entry":"HybridUT","repo":"scaomath/eit-transformer","repo_kind":"official","path":"libs/hut.py","file_url":"https://github.com/scaomath/eit-transformer/blob/HEAD/libs/hut.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"73192eb40023eb4e"}},{"code_sha256_prefix":"083b5d5af368508a","entry":"LinearAttention","repo":"scaomath/eit-transformer","repo_kind":"official","path":"libs/hut.py","file_url":"https://github.com/scaomath/eit-transformer/blob/HEAD/libs/hut.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"083b5d5af368508a"}},{"code_sha256_prefix":"af529b0cb3755654","entry":"LinearAttentionDecoder","repo":"scaomath/eit-transformer","repo_kind":"official","path":"libs/hut.py","file_url":"https://github.com/scaomath/eit-transformer/blob/HEAD/libs/hut.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"af529b0cb3755654"}},{"code_sha256_prefix":"b6af3b0a7e0023b9","entry":"down_block_trans","repo":"scaomath/eit-transformer","repo_kind":"official","path":"libs/hut.py","file_url":"https://github.com/scaomath/eit-transformer/blob/HEAD/libs/hut.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b6af3b0a7e0023b9"}},{"code_sha256_prefix":"79d54eaacbf71604","entry":"float_token","repo":"zenki229/tmcfpinn","repo_kind":"listed","path":"reference_solvers/lshape_2d/generate_lshape_reference.py","file_url":"https://github.com/zenki229/tmcfpinn/blob/HEAD/reference_solvers/lshape_2d/generate_lshape_reference.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"79d54eaacbf71604"}},{"code_sha256_prefix":"e552f66cdeb2fc00","entry":"frac_bdf_coeff","repo":"zenki229/tmcfpinn","repo_kind":"listed","path":"reference_solvers/lshape_2d/generate_lshape_reference.py","file_url":"https://github.com/zenki229/tmcfpinn/blob/HEAD/reference_solvers/lshape_2d/generate_lshape_reference.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e552f66cdeb2fc00"}},{"code_sha256_prefix":"1bcc22fc4ff56de8","entry":"initial_profile","repo":"zenki229/tmcfpinn","repo_kind":"listed","path":"reference_solvers/lshape_2d/generate_lshape_reference.py","file_url":"https://github.com/zenki229/tmcfpinn/blob/HEAD/reference_solvers/lshape_2d/generate_lshape_reference.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1bcc22fc4ff56de8"}},{"code_sha256_prefix":"3a2f5f3bd29e6bae","entry":"mitlef","repo":"zenki229/tmcfpinn","repo_kind":"listed","path":"src/physics/fractional.py","file_url":"https://github.com/zenki229/tmcfpinn/blob/HEAD/src/physics/fractional.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"3a2f5f3bd29e6bae"}},{"code_sha256_prefix":"d562a082cac25629","entry":"setup_wandb","repo":"zenki229/tmcfpinn","repo_kind":"listed","path":"src/utils/experiments.py","file_url":"https://github.com/zenki229/tmcfpinn/blob/HEAD/src/utils/experiments.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d562a082cac25629"}},{"code_sha256_prefix":"d2839e542dc3f87b","entry":"up_block_trans","repo":"scaomath/eit-transformer","repo_kind":"official","path":"libs/hut.py","file_url":"https://github.com/scaomath/eit-transformer/blob/HEAD/libs/hut.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d2839e542dc3f87b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}