{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/dlf-disentangled-language-focused-multimodal","title":"DLF: Disentangled-Language-Focused Multimodal Sentiment Analysis","arxiv_id":"2412.12225","date":"2024-12-16","proceeding":null,"authors":["Pan Wang","Qiang Zhou","Yawen Wu","Tianlong Chen","Jingtong Hu"],"abstract":"Multimodal Sentiment Analysis (MSA) leverages heterogeneous modalities, such as language, vision, and audio, to enhance the understanding of human sentiment. While existing models often focus on extracting shared information across modalities or directly fusing heterogeneous modalities, such approaches can introduce redundancy and conflicts due to equal treatment of all modalities and the mutual transfer of information between modality pairs. To address these issues, we propose a Disentangled-Language-Focused (DLF) multimodal representation learning framework, which incorporates a feature disentanglement module to separate modality-shared and modality-specific information. To further reduce redundancy and enhance language-targeted features, four geometric measures are introduced to refine the disentanglement process. A Language-Focused Attractor (LFA) is further developed to strengthen language representation by leveraging complementary modality-specific information through a language-guided cross-attention mechanism. The framework also employs hierarchical predictions to improve overall accuracy. Extensive experiments on two popular MSA datasets, CMU-MOSI and CMU-MOSEI, demonstrate the significant performance gains achieved by the proposed DLF framework. Comprehensive ablation studies further validate the effectiveness of the feature disentanglement module, language-focused attractor, and hierarchical predictions. Our code is available at https://github.com/pwang322/DLF.","url_abs":"https://arxiv.org/abs/2412.12225v3","url_pdf":"https://arxiv.org/pdf/2412.12225v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"dlf-disentangled-language-focused-multimodal","repo_url":"https://github.com/pwang322/dlf","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"disentanglement","task_name":"Disentanglement"},{"task_slug":"multimodal-sentiment-analysis","task_name":"Multimodal Sentiment Analysis"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"sentiment-analysis","task_name":"Sentiment Analysis"}],"methods":[{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2412.12225","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2412.12225"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/pwang322/dlf","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":6},"by_repo_kind":{"official":{"samples":6,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"4e67f6752207865b","entry":"MMDataLoader","repo":"pwang322/dlf","repo_kind":"official","path":"data_loader.py","file_url":"https://github.com/pwang322/dlf/blob/HEAD/data_loader.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4e67f6752207865b"}},{"code_sha256_prefix":"0d68bc7ea92abc88","entry":"count_parameters","repo":"pwang322/dlf","repo_kind":"official","path":"utils/functions.py","file_url":"https://github.com/pwang322/dlf/blob/HEAD/utils/functions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"0d68bc7ea92abc88"}},{"code_sha256_prefix":"c8423ee1916002d8","entry":"dict_to_str","repo":"pwang322/dlf","repo_kind":"official","path":"utils/functions.py","file_url":"https://github.com/pwang322/dlf/blob/HEAD/utils/functions.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c8423ee1916002d8"}},{"code_sha256_prefix":"c02a56b7760c2b48","entry":"get_config_regression","repo":"pwang322/dlf","repo_kind":"official","path":"config.py","file_url":"https://github.com/pwang322/dlf/blob/HEAD/config.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c02a56b7760c2b48"}},{"code_sha256_prefix":"6c9f5a030643889f","entry":"get_distillation_kernel","repo":"pwang322/dlf","repo_kind":"official","path":"trains/singleTask/distillnets/get_distillation_kernel.py","file_url":"https://github.com/pwang322/dlf/blob/HEAD/trains/singleTask/distillnets/get_distillation_kernel.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6c9f5a030643889f"}},{"code_sha256_prefix":"dca5254e83bb032b","entry":"get_distillation_kernel","repo":"pwang322/dlf","repo_kind":"official","path":"trains/singleTask/distillnets/get_distillation_kernel_homo.py","file_url":"https://github.com/pwang322/dlf/blob/HEAD/trains/singleTask/distillnets/get_distillation_kernel_homo.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"dca5254e83bb032b"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}