{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/on-the-challenges-of-using-black-box-apis-for","title":"On the Challenges of Using Black-Box APIs for Toxicity Evaluation in Research","arxiv_id":"2304.12397","date":"2023-04-24","proceeding":null,"authors":["Luiza Pozzobon","Beyza Ermis","Patrick Lewis","Sara Hooker"],"abstract":"Perception of toxicity evolves over time and often differs between geographies and cultural backgrounds. Similarly, black-box commercially available APIs for detecting toxicity, such as the Perspective API, are not static, but frequently retrained to address any unattended weaknesses and biases. We evaluate the implications of these changes on the reproducibility of findings that compare the relative merits of models and methods that aim to curb toxicity. Our findings suggest that research that relied on inherited automatic toxicity scores to compare models and techniques may have resulted in inaccurate findings. Rescoring all models from HELM, a widely respected living benchmark, for toxicity with the recent version of the API led to a different ranking of widely used foundation models. We suggest caution in applying apples-to-apples comparisons between studies and lay recommendations for a more structured approach to evaluating toxicity over time. Code and data are available at https://github.com/for-ai/black-box-api-challenges.","url_abs":"https://arxiv.org/abs/2304.12397v1","url_pdf":"https://arxiv.org/pdf/2304.12397v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"on-the-challenges-of-using-black-box-apis-for","repo_url":"https://github.com/for-ai/black-box-api-challenges","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2304.12397","atlas_url":"https://app.syntology.ai/?focus=2304.12397","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2304.12397"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-25T09:33:49+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/for-ai/black-box-api-challenges","reach":{"status":"ok","spdx":"MIT"}}],"summary":{"ran":2,"unverified":1},"by_repo_kind":{"official":{"samples":3,"ran":2,"repositories":1}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":0,"samples":[{"code_sha256_prefix":"ff535bf88cf43cfe","entry":"load_cache","repo":"for-ai/black-box-api-challenges","repo_kind":"official","path":"utils/utils.py","file_url":"https://github.com/for-ai/black-box-api-challenges/blob/HEAD/utils/utils.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"ff535bf88cf43cfe"}},{"code_sha256_prefix":"79236a47198404a3","entry":"unpack_scores","repo":"for-ai/black-box-api-challenges","repo_kind":"official","path":"utils/perspective_api.py","file_url":"https://github.com/for-ai/black-box-api-challenges/blob/HEAD/utils/perspective_api.py","link_basis":"plan_row","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"79236a47198404a3"}},{"code_sha256_prefix":"bcfc4aae16b1f64c","entry":"structure_output_filepath","repo":"for-ai/black-box-api-challenges","repo_kind":"official","path":"utils/utils.py","file_url":"https://github.com/for-ai/black-box-api-challenges/blob/HEAD/utils/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"bcfc4aae16b1f64c"}}]},"arxiv_metadata":null,"syntology_extracted_results":null}