{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/decoupled-side-information-fusion-for","title":"Decoupled Side Information Fusion for Sequential Recommendation","arxiv_id":"2204.11046","date":"2022-04-23","proceeding":null,"authors":["Yueqi Xie","Peilin Zhou","Sunghun Kim"],"abstract":"Side information fusion for sequential recommendation (SR) aims to effectively leverage various side information to enhance the performance of next-item prediction. Most state-of-the-art methods build on self-attention networks and focus on exploring various solutions to integrate the item embedding and side information embeddings before the attention layer. However, our analysis shows that the early integration of various types of embeddings limits the expressiveness of attention matrices due to a rank bottleneck and constrains the flexibility of gradients. Also, it involves mixed correlations among the different heterogeneous information resources, which brings extra disturbance to attention calculation. Motivated by this, we propose Decoupled Side Information Fusion for Sequential Recommendation (DIF-SR), which moves the side information from the input to the attention layer and decouples the attention calculation of various side information and item representation. We theoretically and empirically show that the proposed solution allows higher-rank attention matrices and flexible gradients to enhance the modeling capacity of side information fusion. Also, auxiliary attribute predictors are proposed to further activate the beneficial interaction between side information and item representation learning. Extensive experiments on four real-world datasets demonstrate that our proposed solution stably outperforms state-of-the-art SR models. Further studies show that our proposed solution can be readily incorporated into current attention-based SR models and significantly boost performance. Our source code is available at https://github.com/AIM-SE/DIF-SR.","url_abs":"https://arxiv.org/abs/2204.11046v1","url_pdf":"https://arxiv.org/pdf/2204.11046v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"decoupled-side-information-fusion-for","repo_url":"https://github.com/AIM-SE/DIF-SR","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"sequential-recommendation","task_name":"Sequential Recommendation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2204.11046","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.11046"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/AIM-SE/DIF-SR","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":4,"unverified":1},"by_repo_kind":{"official":{"samples":5,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"b5b0bb176f34b7a4","entry":"activation_layer","repo":"AIM-SE/DIF-SR","repo_kind":"official","path":"recbole/model/layers.py","file_url":"https://github.com/AIM-SE/DIF-SR/blob/HEAD/recbole/model/layers.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b5b0bb176f34b7a4"}},{"code_sha256_prefix":"5a832e04227e57b2","entry":"cluster_info","repo":"AIM-SE/DIF-SR","repo_kind":"official","path":"recbole/evaluator/register.py","file_url":"https://github.com/AIM-SE/DIF-SR/blob/HEAD/recbole/evaluator/register.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5a832e04227e57b2"}},{"code_sha256_prefix":"613c33a07699d085","entry":"cutoff","repo":"AIM-SE/DIF-SR","repo_kind":"official","path":"recbole/evaluator/utils.py","file_url":"https://github.com/AIM-SE/DIF-SR/blob/HEAD/recbole/evaluator/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"613c33a07699d085"}},{"code_sha256_prefix":"27b14a758e6ddd4c","entry":"trunc","repo":"AIM-SE/DIF-SR","repo_kind":"official","path":"recbole/evaluator/utils.py","file_url":"https://github.com/AIM-SE/DIF-SR/blob/HEAD/recbole/evaluator/utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"27b14a758e6ddd4c"}},{"code_sha256_prefix":"d8e614998207a6ea","entry":"pad_sequence","repo":"AIM-SE/DIF-SR","repo_kind":"official","path":"recbole/evaluator/utils.py","file_url":"https://github.com/AIM-SE/DIF-SR/blob/HEAD/recbole/evaluator/utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d8e614998207a6ea"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}