{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/cs60075-team2-at-semeval-2021-task-1-lexical","title":"cs60075_team2 at SemEval-2021 Task 1 : Lexical Complexity Prediction using Transformer-based Language Models pre-trained on various text corpora","arxiv_id":"2106.02340","date":"2021-06-04","proceeding":null,"authors":["Abhilash Nandy","Sayantan Adak","Tanurima Halder","Sai Mahesh Pokala"],"abstract":"This paper describes the performance of the team cs60075_team2 at SemEval 2021 Task 1 - Lexical Complexity Prediction. The main contribution of this paper is to fine-tune transformer-based language models pre-trained on several text corpora, some being general (E.g., Wikipedia, BooksCorpus), some being the corpora from which the CompLex Dataset was extracted, and others being from other specific domains such as Finance, Law, etc. We perform ablation studies on selecting the transformer models and how their individual complexity scores are aggregated to get the resulting complexity scores. Our method achieves a best Pearson Correlation of $0.784$ in sub-task 1 (single word) and $0.836$ in sub-task 2 (multiple word expressions).","url_abs":"https://arxiv.org/abs/2106.02340v1","url_pdf":"https://arxiv.org/pdf/2106.02340v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"cs60075-team2-at-semeval-2021-task-1-lexical","repo_url":"https://github.com/abhi1nandy2/CS60075-Team-2-Task-1","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"cs60075-team2-at-semeval-2021-task-1-lexical","repo_url":"https://github.com/suryasuresh91/Lexical-Complexity-Prediction","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"complex-word-identification","task_name":"Complex Word Identification"},{"task_slug":"lexical-analysis","task_name":"Lexical Analysis"},{"task_slug":"lexical-complexity-prediction","task_name":"Lexical Complexity Prediction"},{"task_slug":"task-2","task_name":"Task 2"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}