{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/who-let-the-dogs-out-modeling-dog-behavior","title":"Who Let The Dogs Out? Modeling Dog Behavior From Visual Data","arxiv_id":"1803.10827","date":"2018-03-28","proceeding":"CVPR 2018 6","authors":["Kiana Ehsani","Hessam Bagherinezhad","Joseph Redmon","Roozbeh Mottaghi","Ali Farhadi"],"abstract":"We introduce the task of directly modeling a visually intelligent agent.\nComputer vision typically focuses on solving various subtasks related to visual\nintelligence. We depart from this standard approach to computer vision; instead\nwe directly model a visually intelligent agent. Our model takes visual\ninformation as input and directly predicts the actions of the agent. Toward\nthis end we introduce DECADE, a large-scale dataset of ego-centric videos from\na dog's perspective as well as her corresponding movements. Using this data we\nmodel how the dog acts and how the dog plans her movements. We show under a\nvariety of metrics that given just visual input we can successfully model this\nintelligent agent in many situations. Moreover, the representation learned by\nour model encodes distinct information compared to representations trained on\nimage classification, and our learned representation can generalize to other\ndomains. In particular, we show strong results on the task of walkable surface\nestimation by using this dog modeling task as representation learning.","url_abs":"http://arxiv.org/abs/1803.10827v2","url_pdf":"http://arxiv.org/pdf/1803.10827v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"who-let-the-dogs-out-modeling-dog-behavior","repo_url":"https://github.com/ehsanik/dogTorch","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[],"datasets_introduced":[{"slug":"decade","name":"DECADE","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=1803.10827","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1803.10827"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/ehsanik/dogTorch","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":1},"by_repo_kind":{"official":{"samples":1,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1b720a5f9c819d13","entry":"conv","repo":"ehsanik/dogTorch","repo_kind":"official","path":"models/fully_convolutional_network.py","file_url":"https://github.com/ehsanik/dogTorch/blob/HEAD/models/fully_convolutional_network.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1b720a5f9c819d13"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}