{"about":{"site":"https://codewithpapers.app","non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page"},"url":"/paper/predicting-subjective-features-from-questions","title":"Predicting Subjective Features of Questions of QA Websites using BERT","arxiv_id":"2002.10107","date":"2020-02-24","proceeding":"ICWR 2020 2","authors":["Issa Annamoradnejad","Mohammadamin Fazli","Jafar Habibi"],"abstract":"Community Question-Answering websites, such as StackOverflow and Quora, expect users to follow specific guidelines in order to maintain content quality. These systems mainly rely on community reports for assessing contents, which has serious problems such as the slow handling of violations, the loss of normal and experienced users' time, the low quality of some reports, and discouraging feedback to new users. Therefore, with the overall goal of providing solutions for automating moderation actions in Q&A websites, we aim to provide a model to predict 20 quality or subjective aspects of questions in QA websites. To this end, we used data gathered by the CrowdSource team at Google Research in 2019 and a fine-tuned pre-trained BERT model on our problem. Based on the evaluation by Mean-Squared-Error (MSE), the model achieved a value of 0.046 after 2 epochs of training, which did not improve substantially in the next ones. Results confirm that by simple fine-tuning, we can achieve accurate models in little time and on less amount of data.","url_abs":"https://arxiv.org/abs/2002.10107v4","url_pdf":"https://arxiv.org/pdf/2002.10107v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"predicting-subjective-features-from-questions","repo_url":"https://github.com/Moradnejad/Predicting-Subjective-Features-on-QA-Websites","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null},{"paper_slug":"predicting-subjective-features-from-questions","repo_url":"https://github.com/google-research/bert","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"predicting-subjective-features-from-questions","repo_url":"https://github.com/graykode/nlp-tutorial","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"predicting-subjective-features-from-questions","repo_url":"https://github.com/huggingface/transformers","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"predicting-subjective-features-from-questions","repo_url":"https://github.com/tensorflow/models/tree/master/official/nlp","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"tf","reach":null}],"tasks":[{"task_slug":"community-question-answering","task_name":"Community Question Answering"},{"task_slug":"question-answering","task_name":"Question Answering"}],"methods":[{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"attention-dropout","method_name":"Attention Dropout"},{"method_slug":"bert","method_name":"BERT"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"linear-warmup-with-linear-decay","method_name":"Linear Warmup With Linear Decay"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"weight-decay","method_name":"Weight Decay"},{"method_slug":"wordpiece","method_name":"WordPiece"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/common-sense-reasoning-on-crowdsource-qa-1","task":"Common Sense Reasoning","dataset":"CrowdSource QA","model":"BERT","rank_in_archive_order":1,"of":1,"metrics":{"MSE":"0.046"},"uses_additional_data":false},{"leaderboard":"/sota/community-question-answering-on-crowdsource-1","task":"Community Question Answering","dataset":"CrowdSource QA","model":"BERT","rank_in_archive_order":1,"of":1,"metrics":{"MSE":"0.046"},"uses_additional_data":false},{"leaderboard":"/sota/question-quality-assessment-on-crowdsource-qa-1","task":"Question Quality Assessment","dataset":"CrowdSource QA","model":"BERT","rank_in_archive_order":1,"of":1,"metrics":{"MSE":"0.046"},"uses_additional_data":false},{"leaderboard":"/sota/reading-comprehension-on-crowdsource-qa-1","task":"Reading Comprehension","dataset":"CrowdSource QA","model":"BERT","rank_in_archive_order":1,"of":1,"metrics":{"MSE":"0.046"},"uses_additional_data":false}],"syntology":{"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers"},"arxiv_metadata":null,"syntology_extracted_results":null}