{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/bridge-prompt-towards-ordinal-action","title":"Bridge-Prompt: Towards Ordinal Action Understanding in Instructional Videos","arxiv_id":"2203.14104","date":"2022-03-26","proceeding":"CVPR 2022 1","authors":["Muheng Li","Lei Chen","Yueqi Duan","Zhilan Hu","Jianjiang Feng","Jie zhou","Jiwen Lu"],"abstract":"Action recognition models have shown a promising capability to classify human actions in short video clips. In a real scenario, multiple correlated human actions commonly occur in particular orders, forming semantically meaningful human activities. Conventional action recognition approaches focus on analyzing single actions. However, they fail to fully reason about the contextual relations between adjacent actions, which provide potential temporal logic for understanding long videos. In this paper, we propose a prompt-based framework, Bridge-Prompt (Br-Prompt), to model the semantics across adjacent actions, so that it simultaneously exploits both out-of-context and contextual information from a series of ordinal actions in instructional videos. More specifically, we reformulate the individual action labels as integrated text prompts for supervision, which bridge the gap between individual action semantics. The generated text prompts are paired with corresponding video clips, and together co-train the text encoder and the video encoder via a contrastive approach. The learned vision encoder has a stronger capability for ordinal-action-related downstream tasks, e.g. action segmentation and human activity recognition. We evaluate the performances of our approach on several video datasets: Georgia Tech Egocentric Activities (GTEA), 50Salads, and the Breakfast dataset. Br-Prompt achieves state-of-the-art on multiple benchmarks. Code is available at https://github.com/ttlmh/Bridge-Prompt","url_abs":"https://arxiv.org/abs/2203.14104v1","url_pdf":"https://arxiv.org/pdf/2203.14104v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"bridge-prompt-towards-ordinal-action","repo_url":"https://github.com/ttlmh/bridge-prompt","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"action-segmentation","task_name":"Action Segmentation"},{"task_slug":"action-understanding","task_name":"Action Understanding"},{"task_slug":"activity-recognition","task_name":"Activity Recognition"},{"task_slug":"human-activity-recognition","task_name":"Human Activity Recognition"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/action-segmentation-on-50-salads-1","task":"Action Segmentation","dataset":"50 Salads","model":"Br-Prompt+ASFormer","rank_in_archive_order":8,"of":28,"metrics":{"Acc":"88.1","Edit":"83.8","F1@10%":"89.2","F1@25%":"87.8","F1@50%":"81.3"},"uses_additional_data":true},{"leaderboard":"/sota/action-segmentation-on-gtea-1","task":"Action Segmentation","dataset":"GTEA","model":"Br-Prompt+ASFormer","rank_in_archive_order":6,"of":28,"metrics":{"Acc":"81.2","Edit":"91.6","F1@10%":"94.1","F1@25%":"92.0","F1@50%":"83.0"},"uses_additional_data":true}],"syntology":{"syntology_url":"https://syntology.ai/paper/2203.14104","atlas_url":"https://app.syntology.ai/?focus=2203.14104","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.14104"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ttlmh/bridge-prompt","reach":{"status":"ok"}},{"provenance":"deterministic:regex_extraction","url":"https://github.com/ttlmh/Bridge-Prompt","reach":{"status":"ok"}}],"summary":{"ran":1,"ran_draft_wrong":1},"by_repo_kind":{"official":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"dc2903bddb9b2f39","entry":"BPromptFusing","repo":"ttlmh/Bridge-Prompt","repo_kind":"official","path":"modules/fusion_module.py","file_url":"https://github.com/ttlmh/Bridge-Prompt/blob/HEAD/modules/fusion_module.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dc2903bddb9b2f39"}},{"code_sha256_prefix":"5cb5985f521b3573","entry":"trunc_normal_","repo":"ttlmh/Bridge-Prompt","repo_kind":"official","path":"modules/fusion_module.py","file_url":"https://github.com/ttlmh/Bridge-Prompt/blob/HEAD/modules/fusion_module.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5cb5985f521b3573"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}