{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/v-lol-a-diagnostic-dataset-for-visual-logical","title":"V-LoL: A Diagnostic Dataset for Visual Logical Learning","arxiv_id":"2306.07743","date":"2023-06-13","proceeding":null,"authors":["Lukas Helff","Wolfgang Stammer","Hikaru Shindo","Devendra Singh Dhami","Kristian Kersting"],"abstract":"Despite the successes of recent developments in visual AI, different shortcomings still exist; from missing exact logical reasoning, to abstract generalization abilities, to understanding complex and noisy scenes. Unfortunately, existing benchmarks, were not designed to capture more than a few of these aspects. Whereas deep learning datasets focus on visually complex data but simple visual reasoning tasks, inductive logic datasets involve complex logical learning tasks, however, lack the visual component. To address this, we propose the diagnostic visual logical learning dataset, V-LoL, that seamlessly combines visual and logical challenges. Notably, we introduce the first instantiation of V-LoL, V-LoL-Train, - a visual rendition of a classic benchmark in symbolic AI, the Michalski train problem. By incorporating intricate visual scenes and flexible logical reasoning tasks within a versatile framework, V-LoL-Train provides a platform for investigating a wide range of visual logical learning challenges. We evaluate a variety of AI systems including traditional symbolic AI, neural AI, as well as neuro-symbolic AI. Our evaluations demonstrate that even SOTA AI faces difficulties in dealing with visual logical learning challenges, highlighting unique advantages and limitations of each methodology. Overall, V-LoL opens up new avenues for understanding and enhancing current abilities in visual logical learning for AI systems.","url_abs":"https://arxiv.org/abs/2306.07743v3","url_pdf":"https://arxiv.org/pdf/2306.07743v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"v-lol-a-diagnostic-dataset-for-visual-logical","repo_url":"https://github.com/ml-research/vlol-dataset-gen","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"diagnostic","task_name":"Diagnostic"},{"task_slug":"logical-reasoning","task_name":"Logical Reasoning"},{"task_slug":"visual-reasoning","task_name":"Visual Reasoning"}],"methods":[{"method_slug":"focus","method_name":"Focus"}],"datasets_introduced":[{"slug":"v-lol-trains","name":"V-LoL-Trains","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2306.07743","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.07743"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ml-research/vlol-dataset-gen","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":9},"by_repo_kind":{"official":{"samples":9,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"42abdc84aef6423f","entry":"camera_view_bounds_2d","repo":"ml-research/vlol-dataset-gen","repo_kind":"official","path":"blender_image_generator/get_b_box.py","file_url":"https://github.com/ml-research/vlol-dataset-gen/blob/HEAD/blender_image_generator/get_b_box.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"42abdc84aef6423f"}},{"code_sha256_prefix":"97b29bd21738c149","entry":"clamp","repo":"ml-research/vlol-dataset-gen","repo_kind":"official","path":"blender_image_generator/get_b_box.py","file_url":"https://github.com/ml-research/vlol-dataset-gen/blob/HEAD/blender_image_generator/get_b_box.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"97b29bd21738c149"}},{"code_sha256_prefix":"a2dac797378f951c","entry":"get_new_pos","repo":"ml-research/vlol-dataset-gen","repo_kind":"official","path":"blender_image_generator/blender_util.py","file_url":"https://github.com/ml-research/vlol-dataset-gen/blob/HEAD/blender_image_generator/blender_util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"a2dac797378f951c"}},{"code_sha256_prefix":"7652a907f081e4ac","entry":"get_random_angle","repo":"ml-research/vlol-dataset-gen","repo_kind":"official","path":"raw/gen_raw_trains.py","file_url":"https://github.com/ml-research/vlol-dataset-gen/blob/HEAD/raw/gen_raw_trains.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7652a907f081e4ac"}},{"code_sha256_prefix":"6afb4c88253b8d48","entry":"get_scale","repo":"ml-research/vlol-dataset-gen","repo_kind":"official","path":"blender_image_generator/blender_util.py","file_url":"https://github.com/ml-research/vlol-dataset-gen/blob/HEAD/blender_image_generator/blender_util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6afb4c88253b8d48"}},{"code_sha256_prefix":"4de55b923fec477a","entry":"merge","repo":"ml-research/vlol-dataset-gen","repo_kind":"official","path":"util.py","file_url":"https://github.com/ml-research/vlol-dataset-gen/blob/HEAD/util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4de55b923fec477a"}},{"code_sha256_prefix":"5b5bb975ef1ebcee","entry":"numpy2torch","repo":"ml-research/vlol-dataset-gen","repo_kind":"official","path":"util.py","file_url":"https://github.com/ml-research/vlol-dataset-gen/blob/HEAD/util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5b5bb975ef1ebcee"}},{"code_sha256_prefix":"69420971b8594eb5","entry":"torch2numpy","repo":"ml-research/vlol-dataset-gen","repo_kind":"official","path":"util.py","file_url":"https://github.com/ml-research/vlol-dataset-gen/blob/HEAD/util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"69420971b8594eb5"}},{"code_sha256_prefix":"faa5a1239e236050","entry":"write_bounds_2d_return","repo":"ml-research/vlol-dataset-gen","repo_kind":"official","path":"blender_image_generator/get_b_box.py","file_url":"https://github.com/ml-research/vlol-dataset-gen/blob/HEAD/blender_image_generator/get_b_box.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"faa5a1239e236050"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}