{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/arxiv-2602-11968","title":"DHPLT: large-scale multilingual diachronic corpora and word representations for semantic change modelling","arxiv_id":"2602.11968","date":"2026-02-12","proceeding":null,"authors":["Mariia Fedorova","Andrey Kutuzov","Khonzoda Umarova"],"abstract":"In this resource paper, we present DHPLT, an open collection of diachronic corpora in 41 diverse languages. DHPLT is based on the web-crawled HPLT datasets; we use web crawl timestamps as the approximate signal of document creation time. The collection covers three time periods: 2011-2015, 2020-2021 and 2024-present (1 million documents per time period for each language). We additionally provide pre-computed word type and token embeddings and lexical substitutions for our chosen target words, while at the same time leaving it open for the other researchers to come up with their own target words using the same datasets. DHPLT aims at filling in the current lack of multilingual diachronic corpora for semantic change modelling (beyond a dozen of high-resource languages). It opens the way for a variety of new experimental setups in this field. All the resources described in this paper are available at https://data.hplt-project.org/three/diachronic/, sorted by language.","url_abs":"https://arxiv.org/abs/2602.11968","url_pdf":"https://arxiv.org/pdf/2602.11968","source":{"archive":null,"snapshot":"2025-07-28","note":"not in the Papers with Code archive (frozen at the snapshot)","row_kind":"graph","title_abstract_authors_date":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)"},"code_links":[],"tasks":[],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"atlas_url":"https://app.syntology.ai/?focus=2602.11968","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2602.11968"}},"developers":"https://syntology.ai/developers","read_at":"2026-09-24T18:15:14+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/fxsjy/jieba","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/polm/fugashi","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/pablop16n/web-docs-scorer","reach":null},{"mentioned_in_github":null,"is_official":null,"provenance":"deterministic:regex_extraction","mentioned_in_paper":null,"url":"https://github.com/PyThaiNLP/pythainlp","reach":null}],"summary":{"unverified":7},"by_repo_kind":{"found_in_text":{"samples":7,"ran":0,"repositories":3}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":3,"samples":[{"code_sha256_prefix":"b07c420673610f1b","entry":"average","repo":"pablop16n/web-docs-scorer","repo_kind":"found_in_text","path":"src/docscorer/utils.py","file_url":"https://github.com/pablop16n/web-docs-scorer/blob/HEAD/src/docscorer/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"b07c420673610f1b"}},{"code_sha256_prefix":"4e57b72a525de96a","entry":"custom_mean","repo":"pablop16n/web-docs-scorer","repo_kind":"found_in_text","path":"src/docscorer/utils.py","file_url":"https://github.com/pablop16n/web-docs-scorer/blob/HEAD/src/docscorer/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"4e57b72a525de96a"}},{"code_sha256_prefix":"1a7014fba739a024","entry":"get_corpus","repo":"PyThaiNLP/pythainlp","repo_kind":"found_in_text","path":"pythainlp/corpus/core.py","file_url":"https://github.com/PyThaiNLP/pythainlp/blob/HEAD/pythainlp/corpus/core.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1a7014fba739a024"}},{"code_sha256_prefix":"223fca5537ebbc37","entry":"join_utf_blocks","repo":"pablop16n/web-docs-scorer","repo_kind":"found_in_text","path":"src/docscorer/utils.py","file_url":"https://github.com/pablop16n/web-docs-scorer/blob/HEAD/src/docscorer/utils.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"GPL-3.0","inline_ok":false,"mcp_get_code":{"code_sha256":"223fca5537ebbc37"}},{"code_sha256_prefix":"977327489d2258dc","entry":"mecab_config","repo":"polm/fugashi","repo_kind":"found_in_text","path":"fugashi_util.py","file_url":"https://github.com/polm/fugashi/blob/HEAD/fugashi_util.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"mcp_get_code":{"code_sha256":"977327489d2258dc"}},{"code_sha256_prefix":"a6cbc92eb6ae0ecb","entry":"postype2wordnet","repo":"PyThaiNLP/pythainlp","repo_kind":"found_in_text","path":"pythainlp/augment/wordnet.py","file_url":"https://github.com/PyThaiNLP/pythainlp/blob/HEAD/pythainlp/augment/wordnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"a6cbc92eb6ae0ecb"}},{"code_sha256_prefix":"1f0aeec9a4782403","entry":"replace_number","repo":"PyThaiNLP/pythainlp","repo_kind":"found_in_text","path":"pythainlp/braille/core.py","file_url":"https://github.com/PyThaiNLP/pythainlp/blob/HEAD/pythainlp/braille/core.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"mcp_get_code":{"code_sha256":"1f0aeec9a4782403"}}]},"arxiv_metadata":{"licence":"arXiv metadata, CC0 1.0 (https://info.arxiv.org/help/license)","fields":["title","abstract","authors","date"],"primary_category":"cs.CL","source":"arxiv_2026.jsonl"},"syntology_extracted_results":null}