{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/adabrowse-adaptive-video-browser-for","title":"AdaBrowse: Adaptive Video Browser for Efficient Continuous Sign Language Recognition","arxiv_id":"2308.08327","date":"2023-08-16","proceeding":null,"authors":["Lianyu Hu","Liqing Gao","Zekang Liu","Chi-Man Pun","Wei Feng"],"abstract":"Raw videos have been proven to own considerable feature redundancy where in many cases only a portion of frames can already meet the requirements for accurate recognition. In this paper, we are interested in whether such redundancy can be effectively leveraged to facilitate efficient inference in continuous sign language recognition (CSLR). We propose a novel adaptive model (AdaBrowse) to dynamically select a most informative subsequence from input video sequences by modelling this problem as a sequential decision task. In specific, we first utilize a lightweight network to quickly scan input videos to extract coarse features. Then these features are fed into a policy network to intelligently select a subsequence to process. The corresponding subsequence is finally inferred by a normal CSLR model for sentence prediction. As only a portion of frames are processed in this procedure, the total computations can be considerably saved. Besides temporal redundancy, we are also interested in whether the inherent spatial redundancy can be seamlessly integrated together to achieve further efficiency, i.e., dynamically selecting a lowest input resolution for each sample, whose model is referred to as AdaBrowse+. Extensive experimental results on four large-scale CSLR datasets, i.e., PHOENIX14, PHOENIX14-T, CSL-Daily and CSL, demonstrate the effectiveness of AdaBrowse and AdaBrowse+ by achieving comparable accuracy with state-of-the-art methods with 1.44$\\times$ throughput and 2.12$\\times$ fewer FLOPs. Comparisons with other commonly-used 2D CNNs and adaptive efficient methods verify the effectiveness of AdaBrowse. Code is available at \\url{https://github.com/hulianyuyy/AdaBrowse}.","url_abs":"https://arxiv.org/abs/2308.08327v1","url_pdf":"https://arxiv.org/pdf/2308.08327v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"adabrowse-adaptive-video-browser-for","repo_url":"https://github.com/hulianyuyy/adabrowse","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"sign-language-recognition","task_name":"Sign Language Recognition"}],"methods":[{"method_slug":"csl","method_name":"CSL"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/sign-language-recognition-on-csl-daily","task":"Sign Language Recognition","dataset":"CSL-Daily","model":"AdaBrowse","rank_in_archive_order":11,"of":14,"metrics":{"Word Error Rate (WER)":"30.6"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2308.08327","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.08327"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/hulianyuyy/adabrowse","reach":{"status":"ok"}}],"summary":{"ran_draft_wrong":1,"ran":1,"unverified":1},"by_repo_kind":{"official":{"samples":3,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"583f9780bdd00a45","entry":"conv3x3","repo":"hulianyuyy/adabrowse","repo_kind":"official","path":"Stage_one/modules/resnet.py","file_url":"https://github.com/hulianyuyy/adabrowse/blob/HEAD/Stage_one/modules/resnet.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"583f9780bdd00a45"}},{"code_sha256_prefix":"58b8fe3202ad7d23","entry":"resnet18","repo":"hulianyuyy/adabrowse","repo_kind":"official","path":"Stage_two/modules/resnet.py","file_url":"https://github.com/hulianyuyy/adabrowse/blob/HEAD/Stage_two/modules/resnet.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"58b8fe3202ad7d23"}},{"code_sha256_prefix":"15e5ae9656ce1430","entry":"seq_train","repo":"hulianyuyy/adabrowse","repo_kind":"official","path":"Stage_one/seq_scripts.py","file_url":"https://github.com/hulianyuyy/adabrowse/blob/HEAD/Stage_one/seq_scripts.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"15e5ae9656ce1430"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}