{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/wildvis-open-source-visualizer-for-million","title":"WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild","arxiv_id":"2409.03753","date":"2024-09-05","proceeding":null,"authors":["Yuntian Deng","Wenting Zhao","Jack Hessel","Xiang Ren","Claire Cardie","Yejin Choi"],"abstract":"The increasing availability of real-world conversation data offers exciting opportunities for researchers to study user-chatbot interactions. However, the sheer volume of this data makes manually examining individual conversations impractical. To overcome this challenge, we introduce WildVis, an interactive tool that enables fast, versatile, and large-scale conversation analysis. WildVis provides search and visualization capabilities in the text and embedding spaces based on a list of criteria. To manage million-scale datasets, we implemented optimizations including search index construction, embedding precomputation and compression, and caching to ensure responsive user interactions within seconds. We demonstrate WildVis' utility through three case studies: facilitating chatbot misuse research, visualizing and comparing topic distributions across datasets, and characterizing user-specific conversation patterns. WildVis is open-source and designed to be extendable, supporting additional datasets and customized search and visualization functionalities.","url_abs":"https://arxiv.org/abs/2409.03753v2","url_pdf":"https://arxiv.org/pdf/2409.03753v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"chatbot","task_name":"Chatbot"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2409.03753","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2409.03753"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"deterministic:regex_extraction","url":"https://github.com/da03/WildVisualizer","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":3,"unverified":1},"by_repo_kind":{"found_in_text":{"samples":4,"ran":3,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"1255aa2206e59096","entry":"reservoir_sampling","repo":"da03/WildVisualizer","repo_kind":"found_in_text","path":"embed_conversations_firstturn.py","file_url":"https://github.com/da03/WildVisualizer/blob/HEAD/embed_conversations_firstturn.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"1255aa2206e59096"}},{"code_sha256_prefix":"49951f0611c8f5da","entry":"reservoir_sampling","repo":"da03/WildVisualizer","repo_kind":"found_in_text","path":"embed_conversations_firstturn_trytsne.py","file_url":"https://github.com/da03/WildVisualizer/blob/HEAD/embed_conversations_firstturn_trytsne.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"49951f0611c8f5da"}},{"code_sha256_prefix":"514fccf5f99c7a9d","entry":"retrieve","repo":"da03/WildVisualizer","repo_kind":"found_in_text","path":"embed_conversations.py","file_url":"https://github.com/da03/WildVisualizer/blob/HEAD/embed_conversations.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"514fccf5f99c7a9d"}},{"code_sha256_prefix":"6befdf14c737d065","entry":"get_language_distribution","repo":"da03/WildVisualizer","repo_kind":"found_in_text","path":"find_models.py","file_url":"https://github.com/da03/WildVisualizer/blob/HEAD/find_models.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6befdf14c737d065"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}