{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2603-15020","title":"MER-Bench: A Comprehensive Benchmark for Multimodal Meme Reappraisal","arxiv_id":"2603.15020","date":"2026-03-16","proceeding":null,"authors":["Yiqi Nie","Fei Wang","Junjie Chen","Kun Li","Yudi Cai","Dan Guo","Chenglong Li","Meng Wang"],"abstract":"Memes represent a tightly coupled, multimodal form of social expression, in which visual context and overlaid text jointly convey nuanced affect and commentary. Inspired by cognitive reappraisal in psychology, we introduce Meme Reappraisal, a novel multimodal generation task that aims to transform negatively framed memes into constructive ones while preserving their underlying scenario, entities, and structural layout. Unlike prior works on meme understanding or generation, Meme Reappraisal requires emotion-controllable, structure-preserving multimodal transformation under multiple semantic and stylistic constraints. To support this task, we construct MER-Bench, a benchmark of real-world memes with fine-grained multimodal annotations, including source and target emotions, positively rewritten meme text, visual editing specifications, and taxonomy labels covering visual type, sentiment polarity, and layout structure. We further propose a structured evaluation framework based on a multimodal large language model (MLLM)-as-a-Judge paradigm, decomposing performance into modality-level generation quality, affect controllability, structural fidelity, and global affective alignment. Extensive experiments across representative image-editing and multimodal-generation systems reveal substantial gaps in satisfying the constraints of structural preservation, semantic consistency, and affective transformation. We believe MER-Bench establishes a foundation for research on controllable meme editing and emotion-aware multimodal generation. Our code is available at: https://github.com/one-seven17/MER-Bench.","url_abs":"https://arxiv.org/abs/2603.15020","url_pdf":"https://arxiv.org/pdf/2603.15020","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2603.15020","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2603.15020"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/one-seven17/MER-Bench","reach":null}],"summary":{"unverified":6},"by_repo_kind":{"found_in_text":{"samples":6,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":6,"samples":[{"code_sha256_prefix":"3ea4fe9a8337eb9e","entry":"clamp","repo":"one-seven17/MER-Bench","repo_kind":"found_in_text","path":"results/figure_5_a-n.py","file_url":"https://github.com/one-seven17/MER-Bench/blob/HEAD/results/figure_5_a-n.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"3ea4fe9a8337eb9e"}},{"code_sha256_prefix":"1e02b6036b7e0db5","entry":"geo_mean","repo":"one-seven17/MER-Bench","repo_kind":"found_in_text","path":"results/figure_5_a-n.py","file_url":"https://github.com/one-seven17/MER-Bench/blob/HEAD/results/figure_5_a-n.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"1e02b6036b7e0db5"}},{"code_sha256_prefix":"802f7cfd5e57caaa","entry":"hm","repo":"one-seven17/MER-Bench","repo_kind":"found_in_text","path":"results/figure_5_a-n.py","file_url":"https://github.com/one-seven17/MER-Bench/blob/HEAD/results/figure_5_a-n.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"802f7cfd5e57caaa"}},{"code_sha256_prefix":"ea9dae4db0bfcb8a","entry":"image_to_data_url","repo":"one-seven17/MER-Bench","repo_kind":"found_in_text","path":"judge.py","file_url":"https://github.com/one-seven17/MER-Bench/blob/HEAD/judge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"ea9dae4db0bfcb8a"}},{"code_sha256_prefix":"b3599636629687ea","entry":"sha256_bytes","repo":"one-seven17/MER-Bench","repo_kind":"found_in_text","path":"judge.py","file_url":"https://github.com/one-seven17/MER-Bench/blob/HEAD/judge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"b3599636629687ea"}},{"code_sha256_prefix":"653b01dee433dd03","entry":"sha256_file","repo":"one-seven17/MER-Bench","repo_kind":"found_in_text","path":"judge.py","file_url":"https://github.com/one-seven17/MER-Bench/blob/HEAD/judge.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"mcp_get_code":{"code_sha256":"653b01dee433dd03"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}