{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/consensus-measure-of-rankings","title":"Consensus measure of rankings","arxiv_id":"1704.08464","date":"2017-04-27","proceeding":null,"authors":["Zhiwei Lin","Yi Li","Xiaolian Guo"],"abstract":"A ranking is an ordered sequence of items, in which an item with higher\nranking score is more preferred than the items with lower ranking scores. In\nmany information systems, rankings are widely used to represent the preferences\nover a set of items or candidates. The consensus measure of rankings is the\nproblem of how to evaluate the degree to which the rankings agree. The\nconsensus measure can be used to evaluate rankings in many information systems,\nas quite often there is not ground truth available for evaluation.\n  This paper introduces a novel approach for consensus measure of rankings by\nusing graph representation, in which the vertices or nodes are the items and\nthe edges are the relationship of items in the rankings. Such representation\nleads to various algorithms for consensus measure in terms of different aspects\nof rankings, including the number of common patterns, the number of common\npatterns with fixed length and the length of the longest common patterns. The\nproposed measure can be adopted for various types of rankings, such as full\nrankings, partial rankings and rankings with ties. This paper demonstrates how\nthe proposed approaches can be used to evaluate the quality of rank aggregation\nand the quality of top-$k$ rankings from Google and Bing search engines.","url_abs":"http://arxiv.org/abs/1704.08464v2","url_pdf":"http://arxiv.org/pdf/1704.08464v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"consensus-measure-of-rankings","repo_url":"https://github.com/zhiweiuu/secs","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"unanswered"}}],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1704.08464","atlas_url":"https://app.syntology.ai/?focus=1704.08464","mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}