{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/video-repurposing-from-user-generated-content","title":"Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmark","arxiv_id":"2412.08879","date":"2024-12-12","proceeding":null,"authors":["Yongliang Wu","Wenbo Zhu","Jiawang Cao","Yi Lu","Bozheng Li","Weiheng Chi","Zihan Qiu","Lirian Su","Haolin Zheng","Jay Wu","Xu Yang"],"abstract":"The demand for producing short-form videos for sharing on social media platforms has experienced significant growth in recent times. Despite notable advancements in the fields of video summarization and highlight detection, which can create partially usable short films from raw videos, these approaches are often domain-specific and require an in-depth understanding of real-world video content. To tackle this predicament, we propose Repurpose-10K, an extensive dataset comprising over 10,000 videos with more than 120,000 annotated clips aimed at resolving the video long-to-short task. Recognizing the inherent constraints posed by untrained human annotators, which can result in inaccurate annotations for repurposed videos, we propose a two-stage solution to obtain annotations from real-world user-generated content. Furthermore, we offer a baseline model to address this challenging task by integrating audio, visual, and caption aspects through a cross-modal fusion and alignment framework. We aspire for our work to ignite groundbreaking research in the lesser-explored realms of video repurposing.","url_abs":"https://arxiv.org/abs/2412.08879v2","url_pdf":"https://arxiv.org/pdf/2412.08879v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"video-repurposing-from-user-generated-content","repo_url":"https://github.com/yongliang-wu/repurpose","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"highlight-detection","task_name":"Highlight Detection"},{"task_slug":"video-summarization","task_name":"Video Summarization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2412.08879","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2412.08879"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/yongliang-wu/repurpose","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":11},"by_repo_kind":{"official":{"samples":11,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"2375c1f353b51a70","entry":"calculate_ap","repo":"yongliang-wu/repurpose","repo_kind":"official","path":"utils/metrics.py","file_url":"https://github.com/yongliang-wu/repurpose/blob/HEAD/utils/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"2375c1f353b51a70"}},{"code_sha256_prefix":"20dafaff05cb4005","entry":"calculate_recall","repo":"yongliang-wu/repurpose","repo_kind":"official","path":"utils/metrics.py","file_url":"https://github.com/yongliang-wu/repurpose/blob/HEAD/utils/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"20dafaff05cb4005"}},{"code_sha256_prefix":"465bd32ad76194c3","entry":"calculate_tiou","repo":"yongliang-wu/repurpose","repo_kind":"official","path":"utils/metrics.py","file_url":"https://github.com/yongliang-wu/repurpose/blob/HEAD/utils/metrics.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"465bd32ad76194c3"}},{"code_sha256_prefix":"f1d6f311ec1139dc","entry":"collate_fn","repo":"yongliang-wu/repurpose","repo_kind":"official","path":"dataset/RepurposeClip.py","file_url":"https://github.com/yongliang-wu/repurpose/blob/HEAD/dataset/RepurposeClip.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f1d6f311ec1139dc"}},{"code_sha256_prefix":"42f07137aa17a3a8","entry":"collate_fn_test","repo":"yongliang-wu/repurpose","repo_kind":"official","path":"dataset/RepurposeClip.py","file_url":"https://github.com/yongliang-wu/repurpose/blob/HEAD/dataset/RepurposeClip.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"42f07137aa17a3a8"}},{"code_sha256_prefix":"5ed07117b8d00d9c","entry":"ctr_diou_loss_1d","repo":"yongliang-wu/repurpose","repo_kind":"official","path":"models/losses.py","file_url":"https://github.com/yongliang-wu/repurpose/blob/HEAD/models/losses.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5ed07117b8d00d9c"}},{"code_sha256_prefix":"e01b533bd0b88955","entry":"kl_divergence_loss","repo":"yongliang-wu/repurpose","repo_kind":"official","path":"models/losses.py","file_url":"https://github.com/yongliang-wu/repurpose/blob/HEAD/models/losses.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"e01b533bd0b88955"}},{"code_sha256_prefix":"5b0ce5deb4359713","entry":"load_config","repo":"yongliang-wu/repurpose","repo_kind":"official","path":"inference.py","file_url":"https://github.com/yongliang-wu/repurpose/blob/HEAD/inference.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5b0ce5deb4359713"}},{"code_sha256_prefix":"b5e324c2c10d0c39","entry":"preprocessing","repo":"yongliang-wu/repurpose","repo_kind":"official","path":"dataset/RepurposeClip.py","file_url":"https://github.com/yongliang-wu/repurpose/blob/HEAD/dataset/RepurposeClip.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b5e324c2c10d0c39"}},{"code_sha256_prefix":"5500f7dbd94b2c87","entry":"sigmoid_focal_loss","repo":"yongliang-wu/repurpose","repo_kind":"official","path":"models/losses.py","file_url":"https://github.com/yongliang-wu/repurpose/blob/HEAD/models/losses.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5500f7dbd94b2c87"}},{"code_sha256_prefix":"4c6f706544595ef0","entry":"soft_nms_intervals_cpu","repo":"yongliang-wu/repurpose","repo_kind":"official","path":"models/softnms.py","file_url":"https://github.com/yongliang-wu/repurpose/blob/HEAD/models/softnms.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4c6f706544595ef0"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}