{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/t3-vis-a-visual-analytic-framework-for","title":"T3-Vis: a visual analytic framework for Training and fine-Tuning Transformers in NLP","arxiv_id":"2108.13587","date":"2021-08-31","proceeding":null,"authors":["Raymond Li","Wen Xiao","Lanjun Wang","Hyeju Jang","Giuseppe Carenini"],"abstract":"Transformers are the dominant architecture in NLP, but their training and fine-tuning is still very challenging. In this paper, we present the design and implementation of a visual analytic framework for assisting researchers in such process, by providing them with valuable insights about the model's intrinsic properties and behaviours. Our framework offers an intuitive overview that allows the user to explore different facets of the model (e.g., hidden states, attention) through interactive visualization, and allows a suite of built-in algorithms that compute the importance of model components and different parts of the input sequence. Case studies and feedback from a user focus group indicate that the framework is useful, and suggest several improvements.","url_abs":"https://arxiv.org/abs/2108.13587v1","url_pdf":"https://arxiv.org/pdf/2108.13587v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"t3-vis-a-visual-analytic-framework-for","repo_url":"https://github.com/raymondzmc/t3-vis","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2108.13587","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2108.13587"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/raymondzmc/T3-Vis","reach":null}],"summary":{"ran_draft_wrong":1,"ran_honours":1},"by_repo_kind":{"listed":{"samples":2,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":2,"samples":[{"code_sha256_prefix":"fb962beb65f3f102","entry":"find_pruneable_heads_and_indices","repo":"raymondzmc/T3-Vis","repo_kind":"listed","path":"application/utils/head_importance.py","file_url":"https://github.com/raymondzmc/T3-Vis/blob/HEAD/application/utils/head_importance.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"fb962beb65f3f102"}},{"code_sha256_prefix":"b9a3ea601e8ed2d7","entry":"get_taylor_importance","repo":"raymondzmc/T3-Vis","repo_kind":"listed","path":"application/utils/head_importance.py","file_url":"https://github.com/raymondzmc/T3-Vis/blob/HEAD/application/utils/head_importance.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"b9a3ea601e8ed2d7"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}