{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/deliberative-explanations-visualizing-network","title":"Deliberative Explanations: visualizing network insecurities","arxiv_id":null,"date":"2019-12-01","proceeding":"NeurIPS 2019 12","authors":["Pei Wang","Nuno Nvasconcelos"],"abstract":"A new approach to explainable AI, denoted {\\it deliberative explanations,\\/}\n  is proposed. Deliberative explanations are a visualization technique\n  that aims to go beyond the simple visualization of the image regions\n  (or, more generally, input variables) responsible for a network\n  prediction. Instead, they aim to expose the deliberations carried\n  by the network to arrive at that prediction, by uncovering the\n  insecurities of the network about the latter. The\n  explanation consists of a list of insecurities, each composed of\n  1) an image region (more generally, a set of input variables), and 2)\n  an ambiguity formed by the pair of classes responsible for the network\n  uncertainty about the region. Since insecurity detection requires\n  quantifying the difficulty of network predictions, deliberative\n  explanations combine ideas from the literatures on visual explanations and\n  assessment of classification difficulty. More specifically,\n  the proposed implementation\n  combines attributions with respect to both class\n  predictions and a difficulty score.\n  An evaluation protocol that leverages object recognition (CUB200)\n  and scene classification (ADE20K) datasets that combine part and\n  attribute annotations is also introduced to evaluate the accuracy of\n  deliberative explanations. Finally, an experimental evaluation shows that\n  the most accurate explanations are achieved by combining non self-referential\n  difficulty scores and second-order attributions. The resulting\n  insecurities are shown to correlate with regions of attributes that\n  are shared by different classes. Since these regions are also ambiguous\n  for humans, deliberative explanations are intuitive, suggesting that\n  the deliberative process of modern networks correlates with human\n  reasoning.","url_abs":"http://papers.nips.cc/paper/8418-deliberative-explanations-visualizing-network-insecurities","url_pdf":"http://papers.nips.cc/paper/8418-deliberative-explanations-visualizing-network-insecurities.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"deliberative-explanations-visualizing-network","repo_url":"https://github.com/peiwang062/Deliberative-explanation","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"object-recognition","task_name":"Object Recognition"},{"task_slug":"scene-classification","task_name":"Scene Classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}