{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/smutf-schema-matching-using-generative-tags","title":"SMUTF: Schema Matching Using Generative Tags and Hybrid Features","arxiv_id":"2402.01685","date":"2024-01-22","proceeding":null,"authors":["Yu Zhang","Mei Di","Haozheng Luo","Chenwei Xu","Richard Tzong-Han Tsai"],"abstract":"We introduce SMUTF (Schema Matching Using Generative Tags and Hybrid Features), a unique approach for large-scale tabular data schema matching (SM), which assumes that supervised learning does not affect performance in open-domain tasks, thereby enabling effective cross-domain matching. This system uniquely combines rule-based feature engineering, pre-trained language models, and generative large language models. In an innovative adaptation inspired by the Humanitarian Exchange Language, we deploy \"generative tags\" for each data column, enhancing the effectiveness of SM. SMUTF exhibits extensive versatility, working seamlessly with any pre-existing pre-trained embeddings, classification methods, and generative models. Recognizing the lack of extensive, publicly available datasets for SM, we have created and open-sourced the HDXSM dataset from the public humanitarian data. We believe this to be the most exhaustive SM dataset currently available. In evaluations across various public datasets and the novel HDXSM dataset, SMUTF demonstrated exceptional performance, surpassing existing state-of-the-art models in terms of accuracy and efficiency, and improving the F1 score by 11.84% and the AUC of ROC by 5.08%. Code is available at https://github.com/fireindark707/Python-Schema-Matching.","url_abs":"https://arxiv.org/abs/2402.01685v3","url_pdf":"https://arxiv.org/pdf/2402.01685v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"smutf-schema-matching-using-generative-tags","repo_url":"https://github.com/fireindark707/python-schema-matching","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"feature-engineering","task_name":"Feature Engineering"},{"task_slug":"humanitarian","task_name":"Humanitarian"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2402.01685","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.01685"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/fireindark707/python-schema-matching","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":10},"by_repo_kind":{"official":{"samples":10,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"454cca7259d54965","entry":"create_similarity_matrix","repo":"fireindark707/python-schema-matching","repo_kind":"official","path":"cal_column_similarity.py","file_url":"https://github.com/fireindark707/python-schema-matching/blob/HEAD/cal_column_similarity.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"454cca7259d54965"}},{"code_sha256_prefix":"d0a1767b4e776e23","entry":"find_all_keys_values","repo":"fireindark707/python-schema-matching","repo_kind":"official","path":"utils.py","file_url":"https://github.com/fireindark707/python-schema-matching/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d0a1767b4e776e23"}},{"code_sha256_prefix":"411731e041b8ad68","entry":"load_table","repo":"fireindark707/python-schema-matching","repo_kind":"official","path":"self_features.py","file_url":"https://github.com/fireindark707/python-schema-matching/blob/HEAD/self_features.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"411731e041b8ad68"}},{"code_sha256_prefix":"6cc49f29f989d839","entry":"mainly_numeric","repo":"fireindark707/python-schema-matching","repo_kind":"official","path":"self_features.py","file_url":"https://github.com/fireindark707/python-schema-matching/blob/HEAD/self_features.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6cc49f29f989d839"}},{"code_sha256_prefix":"e8961ea558445614","entry":"make_csv_from_json","repo":"fireindark707/python-schema-matching","repo_kind":"official","path":"utils.py","file_url":"https://github.com/fireindark707/python-schema-matching/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e8961ea558445614"}},{"code_sha256_prefix":"c30d94617013b74c","entry":"preprocess_text","repo":"fireindark707/python-schema-matching","repo_kind":"official","path":"relation_features.py","file_url":"https://github.com/fireindark707/python-schema-matching/blob/HEAD/relation_features.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"c30d94617013b74c"}},{"code_sha256_prefix":"77835b36787efed5","entry":"read_mapping","repo":"fireindark707/python-schema-matching","repo_kind":"official","path":"relation_features.py","file_url":"https://github.com/fireindark707/python-schema-matching/blob/HEAD/relation_features.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"77835b36787efed5"}},{"code_sha256_prefix":"501865ce0c7fa3b7","entry":"schema_matching","repo":"fireindark707/python-schema-matching","repo_kind":"official","path":"cal_column_similarity.py","file_url":"https://github.com/fireindark707/python-schema-matching/blob/HEAD/cal_column_similarity.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"501865ce0c7fa3b7"}},{"code_sha256_prefix":"6841a8dff9b5f051","entry":"strict_numeric","repo":"fireindark707/python-schema-matching","repo_kind":"official","path":"self_features.py","file_url":"https://github.com/fireindark707/python-schema-matching/blob/HEAD/self_features.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6841a8dff9b5f051"}},{"code_sha256_prefix":"1cafb7ab99c06935","entry":"table_column_filter","repo":"fireindark707/python-schema-matching","repo_kind":"official","path":"utils.py","file_url":"https://github.com/fireindark707/python-schema-matching/blob/HEAD/utils.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1cafb7ab99c06935"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}