{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/moviebench-a-hierarchical-movie-level-dataset","title":"MovieBench: A Hierarchical Movie Level Dataset for Long Video Generation","arxiv_id":"2411.15262","date":"2024-11-22","proceeding":"CVPR 2025 1","authors":["Weijia Wu","MingYu Liu","Zeyu Zhu","Xi Xia","Haoen Feng","Wen Wang","Kevin Qinghong Lin","Chunhua Shen","Mike Zheng Shou"],"abstract":"Recent advancements in video generation models, like Stable Video Diffusion, show promising results, but primarily focus on short, single-scene videos. These models struggle with generating long videos that involve multiple scenes, coherent narratives, and consistent characters. Furthermore, there is no publicly available dataset tailored for the analysis, evaluation, and training of long video generation models. In this paper, we present MovieBench: A Hierarchical Movie-Level Dataset for Long Video Generation, which addresses these challenges by providing unique contributions: (1) movie-length videos featuring rich, coherent storylines and multi-scene narratives, (2) consistency of character appearance and audio across scenes, and (3) hierarchical data structure contains high-level movie information and detailed shot-level descriptions. Experiments demonstrate that MovieBench brings some new insights and challenges, such as maintaining character ID consistency across multiple scenes for various characters. The dataset will be public and continuously maintained, aiming to advance the field of long video generation. Data can be found at: https://weijiawu.github.io/MovieBench/.","url_abs":"https://arxiv.org/abs/2411.15262v2","url_pdf":"https://arxiv.org/pdf/2411.15262v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"moviebench-a-hierarchical-movie-level-dataset","repo_url":"https://github.com/showlab/moviebecnh","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"video-generation","task_name":"Video Generation"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":"https://app.syntology.ai/?focus=2411.15262","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2411.15262"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/showlab/moviebecnh","reach":{"status":"ok"}}],"summary":{"ran_draft_wrong":1,"ran_fixture":1,"unverified":12},"by_repo_kind":{"official":{"samples":14,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":14,"samples":[{"code_sha256_prefix":"f41cb1a19b154297","entry":"encode_image","repo":"showlab/moviebecnh","repo_kind":"official","path":"MovieBench/utils.py","file_url":"https://github.com/showlab/moviebecnh/blob/HEAD/MovieBench/utils.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"f41cb1a19b154297"}},{"code_sha256_prefix":"33b7df59642bf5f9","entry":"trans","repo":"showlab/moviebecnh","repo_kind":"official","path":"metrics/Metric_6_FVD/calculate_fvd.py","file_url":"https://github.com/showlab/moviebecnh/blob/HEAD/metrics/Metric_6_FVD/calculate_fvd.py","link_basis":"harvester_set","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"33b7df59642bf5f9"}},{"code_sha256_prefix":"265e4c1627452016","entry":"calculate_fvd","repo":"showlab/moviebecnh","repo_kind":"official","path":"metrics/Metric_6_FVD/calculate_fvd.py","file_url":"https://github.com/showlab/moviebecnh/blob/HEAD/metrics/Metric_6_FVD/calculate_fvd.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"265e4c1627452016"}},{"code_sha256_prefix":"bcebc417626852d6","entry":"calculate_precision_recall_f1","repo":"showlab/moviebecnh","repo_kind":"official","path":"metrics/Metric_5_Character_ID_Consistency.py","file_url":"https://github.com/showlab/moviebecnh/blob/HEAD/metrics/Metric_5_Character_ID_Consistency.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"bcebc417626852d6"}},{"code_sha256_prefix":"270b7c941a61baa4","entry":"calculate_psnr","repo":"showlab/moviebecnh","repo_kind":"official","path":"metrics/Metric_6_FVD/calculate_psnr.py","file_url":"https://github.com/showlab/moviebecnh/blob/HEAD/metrics/Metric_6_FVD/calculate_psnr.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"270b7c941a61baa4"}},{"code_sha256_prefix":"8ed0dfd2d48a289c","entry":"compare_characters","repo":"showlab/moviebecnh","repo_kind":"official","path":"metrics/Metric_5_Character_ID_Consistency.py","file_url":"https://github.com/showlab/moviebecnh/blob/HEAD/metrics/Metric_5_Character_ID_Consistency.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"8ed0dfd2d48a289c"}},{"code_sha256_prefix":"89a6971a43060990","entry":"get_aesthetic_model","repo":"showlab/moviebecnh","repo_kind":"official","path":"metrics/Metric_3_aesthetic_score.py","file_url":"https://github.com/showlab/moviebecnh/blob/HEAD/metrics/Metric_3_aesthetic_score.py","link_basis":"plan_row","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"89a6971a43060990"}},{"code_sha256_prefix":"dac7bf1d63f2a4be","entry":"get_random_frame_from_video","repo":"showlab/moviebecnh","repo_kind":"official","path":"metrics/Metric_4_fid.py","file_url":"https://github.com/showlab/moviebecnh/blob/HEAD/metrics/Metric_4_fid.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"dac7bf1d63f2a4be"}},{"code_sha256_prefix":"79828c36e2f71e9e","entry":"img_psnr","repo":"showlab/moviebecnh","repo_kind":"official","path":"metrics/Metric_6_FVD/calculate_psnr.py","file_url":"https://github.com/showlab/moviebecnh/blob/HEAD/metrics/Metric_6_FVD/calculate_psnr.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"79828c36e2f71e9e"}},{"code_sha256_prefix":"efefbb597027e742","entry":"load_json_files","repo":"showlab/moviebecnh","repo_kind":"official","path":"metrics/Metric_5_Character_ID_Consistency.py","file_url":"https://github.com/showlab/moviebecnh/blob/HEAD/metrics/Metric_5_Character_ID_Consistency.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"efefbb597027e742"}},{"code_sha256_prefix":"5a316fbcbabb3efd","entry":"read_txt","repo":"showlab/moviebecnh","repo_kind":"official","path":"MovieBench/utils.py","file_url":"https://github.com/showlab/moviebecnh/blob/HEAD/MovieBench/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"5a316fbcbabb3efd"}},{"code_sha256_prefix":"a0bb3768ee24ee05","entry":"trans","repo":"showlab/moviebecnh","repo_kind":"official","path":"metrics/Metric_6_FVD/calculate_lpips.py","file_url":"https://github.com/showlab/moviebecnh/blob/HEAD/metrics/Metric_6_FVD/calculate_lpips.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"a0bb3768ee24ee05"}},{"code_sha256_prefix":"4f6235b68bad4f04","entry":"trans","repo":"showlab/moviebecnh","repo_kind":"official","path":"metrics/Metric_6_FVD/calculate_psnr.py","file_url":"https://github.com/showlab/moviebecnh/blob/HEAD/metrics/Metric_6_FVD/calculate_psnr.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"4f6235b68bad4f04"}},{"code_sha256_prefix":"3c3553f5e5cc4fd7","entry":"video2frame","repo":"showlab/moviebecnh","repo_kind":"official","path":"MovieBench/utils.py","file_url":"https://github.com/showlab/moviebecnh/blob/HEAD/MovieBench/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3c3553f5e5cc4fd7"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}