{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/coco-performance-assessment","title":"COCO: Performance Assessment","arxiv_id":"1605.03560","date":"2016-05-11","proceeding":null,"authors":["Nikolaus Hansen","Anne Auger","Dimo Brockhoff","Dejan Tušar","Tea Tušar"],"abstract":"We present an any-time performance assessment for benchmarking numerical\noptimization algorithms in a black-box scenario, applied within the COCO\nbenchmarking platform. The performance assessment is based on runtimes measured\nin number of objective function evaluations to reach one or several quality\nindicator target values. We argue that runtime is the only available measure\nwith a generic, meaningful, and quantitative interpretation. We discuss the\nchoice of the target values, runlength-based targets, and the aggregation of\nresults by using simulated restarts, averages, and empirical distribution\nfunctions.","url_abs":"http://arxiv.org/abs/1605.03560v1","url_pdf":"http://arxiv.org/pdf/1605.03560v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"coco-performance-assessment","repo_url":"https://github.com/courros/hnco","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"benchmarking","task_name":"Benchmarking"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}