{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/soar-scene-debiasing-open-set-action-1","title":"SOAR: Scene-debiasing Open-set Action Recognition","arxiv_id":"2309.01265","date":"2023-09-03","proceeding":"ICCV 2023 1","authors":["Yuanhao Zhai","Ziyi Liu","Zhenyu Wu","Yi Wu","Chunluan Zhou","David Doermann","Junsong Yuan","Gang Hua"],"abstract":"Deep learning models have a risk of utilizing spurious clues to make predictions, such as recognizing actions based on the background scene. This issue can severely degrade the open-set action recognition performance when the testing samples have different scene distributions from the training samples. To mitigate this problem, we propose a novel method, called Scene-debiasing Open-set Action Recognition (SOAR), which features an adversarial scene reconstruction module and an adaptive adversarial scene classification module. The former prevents the decoder from reconstructing the video background given video features, and thus helps reduce the background information in feature learning. The latter aims to confuse scene type classification given video features, with a specific emphasis on the action foreground, and helps to learn scene-invariant information. In addition, we design an experiment to quantify the scene bias. The results indicate that the current open-set action recognizers are biased toward the scene, and our proposed SOAR method better mitigates such bias. Furthermore, our extensive experiments demonstrate that our method outperforms state-of-the-art methods, and the ablation studies confirm the effectiveness of our proposed modules.","url_abs":"https://arxiv.org/abs/2309.01265v1","url_pdf":"https://arxiv.org/pdf/2309.01265v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"soar-scene-debiasing-open-set-action-1","repo_url":"https://github.com/yhZhai/SOAR","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"open-set-action-recognition","task_name":"Open Set Action Recognition"},{"task_slug":"scene-classification","task_name":"Scene Classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2309.01265","atlas_url":"https://app.syntology.ai/?focus=2309.01265","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.01265"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yhZhai/SOAR","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":9,"ran_honours":1,"unverified":2},"by_repo_kind":{"official":{"samples":12,"ran":10,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"d0ddd50f31a39641","entry":"anchor","repo":"yhZhai/SOAR","repo_kind":"official","path":"docs_zh_CN/stat.py","file_url":"https://github.com/yhZhai/SOAR/blob/HEAD/docs_zh_CN/stat.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"d0ddd50f31a39641"}},{"code_sha256_prefix":"49c3c12dc62fa96b","entry":"get_indices","repo":"yhZhai/SOAR","repo_kind":"official","path":"experiments/draw_uncertainty_distribution.py","file_url":"https://github.com/yhZhai/SOAR/blob/HEAD/experiments/draw_uncertainty_distribution.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"49c3c12dc62fa96b"}},{"code_sha256_prefix":"e06ec986367edd6c","entry":"get_ood_acc","repo":"yhZhai/SOAR","repo_kind":"official","path":"experiments/open_set_evaluation.py","file_url":"https://github.com/yhZhai/SOAR/blob/HEAD/experiments/open_set_evaluation.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e06ec986367edd6c"}},{"code_sha256_prefix":"ea1109a89f638356","entry":"get_ood_datalist","repo":"yhZhai/SOAR","repo_kind":"official","path":"experiments/analyze_scene_bias.py","file_url":"https://github.com/yhZhai/SOAR/blob/HEAD/experiments/analyze_scene_bias.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"ea1109a89f638356"}},{"code_sha256_prefix":"8c4fbd5e5329d6c7","entry":"get_open_maf1","repo":"yhZhai/SOAR","repo_kind":"official","path":"experiments/analyze_scene_bias.py","file_url":"https://github.com/yhZhai/SOAR/blob/HEAD/experiments/analyze_scene_bias.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8c4fbd5e5329d6c7"}},{"code_sha256_prefix":"03feb5deb14d8343","entry":"get_stochastic_uncertainty_fn","repo":"yhZhai/SOAR","repo_kind":"official","path":"experiments/ood_detection.py","file_url":"https://github.com/yhZhai/SOAR/blob/HEAD/experiments/ood_detection.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"03feb5deb14d8343"}},{"code_sha256_prefix":"227c51480967ab11","entry":"get_video_name_from_datalist","repo":"yhZhai/SOAR","repo_kind":"official","path":"experiments/analyze_scene_bias.py","file_url":"https://github.com/yhZhai/SOAR/blob/HEAD/experiments/analyze_scene_bias.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"227c51480967ab11"}},{"code_sha256_prefix":"65c16032c4c2e917","entry":"gram_linear","repo":"yhZhai/SOAR","repo_kind":"official","path":"experiments/compare_feature_similarity.py","file_url":"https://github.com/yhZhai/SOAR/blob/HEAD/experiments/compare_feature_similarity.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"65c16032c4c2e917"}},{"code_sha256_prefix":"80314ffcc884fcc5","entry":"gram_rbf","repo":"yhZhai/SOAR","repo_kind":"official","path":"experiments/compare_feature_similarity.py","file_url":"https://github.com/yhZhai/SOAR/blob/HEAD/experiments/compare_feature_similarity.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"80314ffcc884fcc5"}},{"code_sha256_prefix":"3187403d89a3003a","entry":"to_numpy","repo":"yhZhai/SOAR","repo_kind":"official","path":"experiments/compare_feature_similarity.py","file_url":"https://github.com/yhZhai/SOAR/blob/HEAD/experiments/compare_feature_similarity.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"3187403d89a3003a"}},{"code_sha256_prefix":"6d45c7858760b1bb","entry":"get_class_names","repo":"yhZhai/SOAR","repo_kind":"official","path":"experiments/draw_uncertainty_distribution.py","file_url":"https://github.com/yhZhai/SOAR/blob/HEAD/experiments/draw_uncertainty_distribution.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6d45c7858760b1bb"}},{"code_sha256_prefix":"8dd75826e2ff1516","entry":"get_results","repo":"yhZhai/SOAR","repo_kind":"official","path":"experiments/analyze_recon_uncertainty.py","file_url":"https://github.com/yhZhai/SOAR/blob/HEAD/experiments/analyze_recon_uncertainty.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"8dd75826e2ff1516"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}