{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/2408-02901","title":"Lighthouse: A User-Friendly Library for Reproducible Video Moment Retrieval and Highlight Detection","arxiv_id":"2408.02901","date":"2024-08-06","proceeding":null,"authors":["Taichi Nishimura","Shota Nakada","Hokuto Munakata","Tatsuya Komatsu"],"abstract":"We propose Lighthouse, a user-friendly library for reproducible video moment retrieval and highlight detection (MR-HD). Although researchers proposed various MR-HD approaches, the research community holds two main issues. The first is a lack of comprehensive and reproducible experiments across various methods, datasets, and video-text features. This is because no unified training and evaluation codebase covers multiple settings. The second is user-unfriendly design. Because previous works use different libraries, researchers set up individual environments. In addition, most works release only the training codes, requiring users to implement the whole inference process of MR-HD. Lighthouse addresses these issues by implementing a unified reproducible codebase that includes six models, three features, and five datasets. In addition, it provides an inference API and web demo to make these methods easily accessible for researchers and developers. Our experiments demonstrate that Lighthouse generally reproduces the reported scores in the reference papers. The code is available at https://github.com/line/lighthouse.","url_abs":"https://arxiv.org/abs/2408.02901v3","url_pdf":"https://arxiv.org/pdf/2408.02901v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"2408-02901","repo_url":"https://github.com/line/lighthouse","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"highlight-detection","task_name":"Highlight Detection"},{"task_slug":"moment-retrieval","task_name":"Moment Retrieval"},{"task_slug":"audio-moment-retrieval","task_name":"audio moment retrieval"}],"methods":[{"method_slug":null,"method_name":"Library"},{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2408.02901","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2408.02901"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/line/lighthouse","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":3,"ran_honours":1,"ran_draft_wrong":1,"unverified":6},"by_repo_kind":{"official":{"samples":11,"ran":5,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"55061d5f6c78072b","entry":"BMRW","repo":"line/lighthouse","repo_kind":"official","path":"lighthouse/common/CIM.py","file_url":"https://github.com/line/lighthouse/blob/HEAD/lighthouse/common/CIM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"55061d5f6c78072b"}},{"code_sha256_prefix":"4557aa0c781bc84a","entry":"EM_RBF","repo":"line/lighthouse","repo_kind":"official","path":"lighthouse/common/CIM.py","file_url":"https://github.com/line/lighthouse/blob/HEAD/lighthouse/common/CIM.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4557aa0c781bc84a"}},{"code_sha256_prefix":"eb592047bcf7242f","entry":"calculate_l1_norm","repo":"line/lighthouse","repo_kind":"official","path":"lighthouse/common/CIM.py","file_url":"https://github.com/line/lighthouse/blob/HEAD/lighthouse/common/CIM.py","link_basis":"plan_row","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"eb592047bcf7242f"}},{"code_sha256_prefix":"65ed3cfb70bc04bd","entry":"gen_sineembed_for_position","repo":"line/lighthouse","repo_kind":"official","path":"lighthouse/common/eatr_transformer.py","file_url":"https://github.com/line/lighthouse/blob/HEAD/lighthouse/common/eatr_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"65ed3cfb70bc04bd"}},{"code_sha256_prefix":"6897880b6ce14c94","entry":"inverse_sigmoid","repo":"line/lighthouse","repo_kind":"official","path":"lighthouse/common/cg_detr.py","file_url":"https://github.com/line/lighthouse/blob/HEAD/lighthouse/common/cg_detr.py","link_basis":"harvester_set","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6897880b6ce14c94"}},{"code_sha256_prefix":"081c8abd57d082fd","entry":"accuracy","repo":"line/lighthouse","repo_kind":"official","path":"lighthouse/common/misc.py","file_url":"https://github.com/line/lighthouse/blob/HEAD/lighthouse/common/misc.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"081c8abd57d082fd"}},{"code_sha256_prefix":"6d07870656ce939e","entry":"element_wise_list_equal","repo":"line/lighthouse","repo_kind":"official","path":"lighthouse/common/cg_detr.py","file_url":"https://github.com/line/lighthouse/blob/HEAD/lighthouse/common/cg_detr.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6d07870656ce939e"}},{"code_sha256_prefix":"f2157348a4ae2f51","entry":"find_nth","repo":"line/lighthouse","repo_kind":"official","path":"lighthouse/common/cg_detr.py","file_url":"https://github.com/line/lighthouse/blob/HEAD/lighthouse/common/cg_detr.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"f2157348a4ae2f51"}},{"code_sha256_prefix":"84a83d94394b10af","entry":"gen_sineembed_for_position","repo":"line/lighthouse","repo_kind":"official","path":"lighthouse/common/cg_detr_transformer.py","file_url":"https://github.com/line/lighthouse/blob/HEAD/lighthouse/common/cg_detr_transformer.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"84a83d94394b10af"}},{"code_sha256_prefix":"a82091666b9db8cf","entry":"multi_head_attention_forward","repo":"line/lighthouse","repo_kind":"official","path":"lighthouse/common/attention.py","file_url":"https://github.com/line/lighthouse/blob/HEAD/lighthouse/common/attention.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a82091666b9db8cf"}},{"code_sha256_prefix":"5d7fc668e3b608cf","entry":"multi_head_attention_forward","repo":"line/lighthouse","repo_kind":"official","path":"lighthouse/common/crossattention.py","file_url":"https://github.com/line/lighthouse/blob/HEAD/lighthouse/common/crossattention.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5d7fc668e3b608cf"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}