{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/automated-detection-of-non-relevant-posts-on","title":"Automated Detection of Non-Relevant Posts on the Russian Imageboard \"2ch\": Importance of the Choice of Word Representations","arxiv_id":"1707.04860","date":"2017-07-16","proceeding":null,"authors":["Amir Bakarov","Olga Gureenkova"],"abstract":"This study considers the problem of automated detection of non-relevant posts\non Web forums and discusses the approach of resolving this problem by\napproximation it with the task of detection of semantic relatedness between the\ngiven post and the opening post of the forum discussion thread. The\napproximated task could be resolved through learning the supervised classifier\nwith a composed word embeddings of two posts. Considering that the success in\nthis task could be quite sensitive to the choice of word representations, we\npropose a comparison of the performance of different word embedding models. We\ntrain 7 models (Word2Vec, Glove, Word2Vec-f, Wang2Vec, AdaGram, FastText,\nSwivel), evaluate embeddings produced by them on dataset of human judgements\nand compare their performance on the task of non-relevant posts detection. To\nmake the comparison, we propose a dataset of semantic relatedness with posts\nfrom one of the most popular Russian Web forums, imageboard \"2ch\", which has\nchallenging lexical and grammatical features.","url_abs":"http://arxiv.org/abs/1707.04860v1","url_pdf":"http://arxiv.org/pdf/1707.04860v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"automated-detection-of-non-relevant-posts-on","repo_url":"https://github.com/bakarov/2ch2vec","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"word-embeddings","task_name":"Word Embeddings"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}