{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/a-system-for-real-time-interactive-analysis","title":"A System for Real-Time Interactive Analysis of Deep Learning Training","arxiv_id":"2001.01215","date":"2020-01-05","proceeding":null,"authors":["Shital Shah","Roland Fernandez","Steven Drucker"],"abstract":"Performing diagnosis or exploratory analysis during the training of deep learning models is challenging but often necessary for making a sequence of decisions guided by the incremental observations. Currently available systems for this purpose are limited to monitoring only the logged data that must be specified before the training process starts. Each time a new information is desired, a cycle of stop-change-restart is required in the training process. These limitations make interactive exploration and diagnosis tasks difficult, imposing long tedious iterations during the model development. We present a new system that enables users to perform interactive queries on live processes generating real-time information that can be rendered in multiple formats on multiple surfaces in the form of several desired visualizations simultaneously. To achieve this, we model various exploratory inspection and diagnostic tasks for deep learning training processes as specifications for streams using a map-reduce paradigm with which many data scientists are already familiar. Our design achieves generality and extensibility by defining composable primitives which is a fundamentally different approach than is used by currently available systems. The open source implementation of our system is available as TensorWatch project at https://github.com/microsoft/tensorwatch.","url_abs":"https://arxiv.org/abs/2001.01215v2","url_pdf":"https://arxiv.org/pdf/2001.01215v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-system-for-real-time-interactive-analysis","repo_url":"https://github.com/microsoft/tensorwatch","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"3d-human-action-recognition","task_name":"3D Action Recognition"},{"task_slug":"diagnostic","task_name":"Diagnostic"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/3d-action-recognition-on-100-sleep-nights-of","task":"3D Action Recognition","dataset":"100 sleep nights of 8 caregivers","model":"htf","rank_in_archive_order":1,"of":1,"metrics":{"10%":"4"},"uses_additional_data":false}],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2001.01215","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2001.01215"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/microsoft/tensorwatch","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"unverified":17},"by_repo_kind":{"official":{"samples":17,"ran":0,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"b89d16adfe8b4e3d","entry":"get_model","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/pytorch_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/pytorch_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b89d16adfe8b4e3d"}},{"code_sha256_prefix":"6c7e3aab6467ff9c","entry":"group_reduce","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/evaler_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/evaler_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"6c7e3aab6467ff9c"}},{"code_sha256_prefix":"05fe7faa77d1a5d2","entry":"guess_image_dims","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/image_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/image_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"05fe7faa77d1a5d2"}},{"code_sha256_prefix":"fd376daff85e13cc","entry":"image2batch","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/imagenet_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/imagenet_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"fd376daff85e13cc"}},{"code_sha256_prefix":"b6ef5930d34ebb10","entry":"int2tensor","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/pytorch_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/pytorch_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b6ef5930d34ebb10"}},{"code_sha256_prefix":"7d4bdc647c5d26ce","entry":"model_stats","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/model_graph/torchstat_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/model_graph/torchstat_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"7d4bdc647c5d26ce"}},{"code_sha256_prefix":"5171f2015e277d67","entry":"model_stats2df","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/model_graph/torchstat_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/model_graph/torchstat_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"5171f2015e277d67"}},{"code_sha256_prefix":"d72c228526cca499","entry":"predict","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/imagenet_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/imagenet_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d72c228526cca499"}},{"code_sha256_prefix":"b1b7bb097a1cc013","entry":"probabilities2classes","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/imagenet_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/imagenet_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"b1b7bb097a1cc013"}},{"code_sha256_prefix":"bc61c240e64baea0","entry":"pyt_ds2list","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/data_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bc61c240e64baea0"}},{"code_sha256_prefix":"4b2ad2d9ab9bb260","entry":"pyt_tensor2np","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/data_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"4b2ad2d9ab9bb260"}},{"code_sha256_prefix":"758dbeb2636ae3c3","entry":"pyt_tuple2np","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/data_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/data_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"758dbeb2636ae3c3"}},{"code_sha256_prefix":"f9c6d1845ac5da15","entry":"stitch_horizontal","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/image_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/image_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"f9c6d1845ac5da15"}},{"code_sha256_prefix":"c61a459f1a7e6024","entry":"tensors2batch","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/pytorch_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/pytorch_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"c61a459f1a7e6024"}},{"code_sha256_prefix":"d06a7b46db306bc6","entry":"to_imshow_array","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/image_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/image_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"d06a7b46db306bc6"}},{"code_sha256_prefix":"75217e6b03b24101","entry":"to_tuples","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/evaler_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/evaler_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"75217e6b03b24101"}},{"code_sha256_prefix":"ff43ee11f61dfb71","entry":"topk","repo":"microsoft/tensorwatch","repo_kind":"official","path":"tensorwatch/evaler_utils.py","file_url":"https://github.com/microsoft/tensorwatch/blob/HEAD/tensorwatch/evaler_utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ff43ee11f61dfb71"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}