{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2510-21679","title":"A Multimodal Benchmark for Framing of Oil & Gas Advertising and Potential Greenwashing Detection","arxiv_id":"2510.21679","date":"2025-10-24","proceeding":"NeurIPS","authors":["Gaku Morio","Harri Rowlands","Dominik Stammbach","Christopher D. Manning","Peter Henderson"],"abstract":"Companies spend large amounts of money on public relations campaigns to project a positive brand image. However, sometimes there is a mismatch between what they say and what they do. Oil & gas companies, for example, are accused of \"greenwashing\" with imagery of climate-friendly initiatives. Understanding the framing, and changes in framing, at scale can help better understand the goals and nature of public relations campaigns. To address this, we introduce a benchmark dataset of expert-annotated video ads obtained from Facebook and YouTube. The dataset provides annotations for 13 framing types for more than 50 companies or advocacy groups across 20 countries. Our dataset is especially designed for the evaluation of vision-language models (VLMs), distinguishing it from past text-only framing datasets. Baseline experiments show some promising results, while leaving room for improvement for future work: GPT-4.1 can detect environmental messages with 79% F1 score, while our best model only achieves 46% F1 score on identifying framing around green innovation. We also identify challenges that VLMs must address, such as implicit framing, handling videos of various lengths, or implicit cultural backgrounds. Our dataset contributes to research in multimodal analysis of strategic communication in the energy sector.","url_abs":"https://arxiv.org/abs/2510.21679","url_pdf":"https://arxiv.org/pdf/2510.21679","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2510.21679","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2510.21679"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/climate-nlp/multimodal-oil-gas-benchmark","reach":null}],"summary":{"ran_draft_wrong":2,"ran_honours":2},"by_repo_kind":{"found_in_text":{"samples":4,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"6a00a551a4da6221","entry":"calc_precision_recall_f1","repo":"climate-nlp/multimodal-oil-gas-benchmark","repo_kind":"found_in_text","path":"src/score.py","file_url":"https://github.com/climate-nlp/multimodal-oil-gas-benchmark/blob/HEAD/src/score.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"6a00a551a4da6221"}},{"code_sha256_prefix":"b1e51f108e3cfe3a","entry":"evaluate_prediction_file","repo":"climate-nlp/multimodal-oil-gas-benchmark","repo_kind":"found_in_text","path":"src/score.py","file_url":"https://github.com/climate-nlp/multimodal-oil-gas-benchmark/blob/HEAD/src/score.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"b1e51f108e3cfe3a"}},{"code_sha256_prefix":"62eb13d56f4155e4","entry":"parse_label","repo":"climate-nlp/multimodal-oil-gas-benchmark","repo_kind":"found_in_text","path":"src/predict.py","file_url":"https://github.com/climate-nlp/multimodal-oil-gas-benchmark/blob/HEAD/src/predict.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"62eb13d56f4155e4"}},{"code_sha256_prefix":"4bfa371336a2351e","entry":"process_score","repo":"climate-nlp/multimodal-oil-gas-benchmark","repo_kind":"found_in_text","path":"src/score.py","file_url":"https://github.com/climate-nlp/multimodal-oil-gas-benchmark/blob/HEAD/src/score.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"4bfa371336a2351e"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.AI","source":"arxiv_api"},"syntology_extracted_results":null}