{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/the-petshop-dataset-finding-causes-of","title":"The PetShop Dataset -- Finding Causes of Performance Issues across Microservices","arxiv_id":"2311.04806","date":"2023-11-08","proceeding":null,"authors":["Michaela Hardt","William R. Orchard","Patrick Blöbaum","Shiva Kasiviswanathan","Elke Kirschbaum"],"abstract":"Identifying root causes for unexpected or undesirable behavior in complex systems is a prevalent challenge. This issue becomes especially crucial in modern cloud applications that employ numerous microservices. Although the machine learning and systems research communities have proposed various techniques to tackle this problem, there is currently a lack of standardized datasets for quantitative benchmarking. Consequently, research groups are compelled to create their own datasets for experimentation. This paper introduces a dataset specifically designed for evaluating root cause analyses in microservice-based applications. The dataset encompasses latency, requests, and availability metrics emitted in 5-minute intervals from a distributed application. In addition to normal operation metrics, the dataset includes 68 injected performance issues, which increase latency and reduce availability throughout the system. We showcase how this dataset can be used to evaluate the accuracy of a variety of methods spanning different causal and non-causal characterisations of the root cause analysis problem. We hope the new dataset, available at https://github.com/amazon-science/petshop-root-cause-analysis/ enables further development of techniques in this important area.","url_abs":"https://arxiv.org/abs/2311.04806v2","url_pdf":"https://arxiv.org/pdf/2311.04806v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"the-petshop-dataset-finding-causes-of","repo_url":"https://github.com/amazon-science/petshop-root-cause-analysis","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"benchmarking","task_name":"Benchmarking"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2311.04806","atlas_url":"https://app.syntology.ai/?focus=2311.04806","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.04806"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/amazon-science/petshop-root-cause-analysis","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":4,"unverified":2},"by_repo_kind":{"official":{"samples":6,"ran":4,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"16cec641c1aa2a80","entry":"load_scenario","repo":"amazon-science/petshop-root-cause-analysis","repo_kind":"official","path":"code/rca_task.py","file_url":"https://github.com/amazon-science/petshop-root-cause-analysis/blob/HEAD/code/rca_task.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"16cec641c1aa2a80"}},{"code_sha256_prefix":"e75574a3fc479079","entry":"map_df","repo":"amazon-science/petshop-root-cause-analysis","repo_kind":"official","path":"code/data_preprocessing.py","file_url":"https://github.com/amazon-science/petshop-root-cause-analysis/blob/HEAD/code/data_preprocessing.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e75574a3fc479079"}},{"code_sha256_prefix":"a02d81be5066e190","entry":"pad_and_fill","repo":"amazon-science/petshop-root-cause-analysis","repo_kind":"official","path":"code/counterfactual_attribution.py","file_url":"https://github.com/amazon-science/petshop-root-cause-analysis/blob/HEAD/code/counterfactual_attribution.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a02d81be5066e190"}},{"code_sha256_prefix":"5c4500df13246a46","entry":"reduce_df","repo":"amazon-science/petshop-root-cause-analysis","repo_kind":"official","path":"code/counterfactual_attribution.py","file_url":"https://github.com/amazon-science/petshop-root-cause-analysis/blob/HEAD/code/counterfactual_attribution.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"5c4500df13246a46"}},{"code_sha256_prefix":"584c5668c01f4b7c","entry":"evaluate","repo":"amazon-science/petshop-root-cause-analysis","repo_kind":"official","path":"code/rca_task.py","file_url":"https://github.com/amazon-science/petshop-root-cause-analysis/blob/HEAD/code/rca_task.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"584c5668c01f4b7c"}},{"code_sha256_prefix":"e2dc0a8836eba4db","entry":"evaluate_specificity","repo":"amazon-science/petshop-root-cause-analysis","repo_kind":"official","path":"code/rca_task.py","file_url":"https://github.com/amazon-science/petshop-root-cause-analysis/blob/HEAD/code/rca_task.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"e2dc0a8836eba4db"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}