Papers › Knowledge-aware response selection with semantics underlying multi-turn open-domain...

Knowledge-aware response selection with semantics underlying multi-turn open-domain conversations

27 Jul 2023World Wide Web Journal 2023 7archive 2025-07-28

Makoto Nakatsuji, Yuka Ozeki, Shuhei Tateishi, Yoshihisa Kano & QingPeng Zhang

Response selection is a critical issue in the AI community, with important applications on the Web. The accuracy of the selected responses, however, tends to be insufficient due to the lack of contextual awareness, especially in open-domain conversations where words tend to have several meanings in different contexts. Our solution, SemSol, is a knowledge-aware response selection model that tackles this problem by utilizing the context-specific semantics behind words that are implicitly shared among users throughout the dialogue. SemSol simultaneously learns word sense disambiguations (WSD) for the words in the dialogue on the basis of an open-domain knowledge graph, i.e. WordNet, while learning the match between the context and the response candidates. Then, SemSol improves the accuracy of the response by exploiting the semantic information in a knowledge graph in accordance with the dialogue context. Our model learns the topics of utterances in the context of the whole training dataset. This topic-level knowledge can provide topic-specific information in the dialogue context. This improves the WSDs and the response selection accuracy. Experiments with two open-domain conversational datasets, Douban (Chinese) and Reddit (English), demonstrated that the SemSol model outperformed state-of-the-art baselines. SemSol is ranked #1 on the Douban leaderboard.

PaperPDFCode

Code

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Conversational Response Selection

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Conversational Response Selection Douban SEMSOL(W/o utterances) MAP 0.651 #1 of 16 Archive leaderboard report
Conversational Response Selection Douban SEMSOL(W/o utterances) MRR 0.687 #1 of 16 Archive leaderboard report
Conversational Response Selection Douban SEMSOL(W/o utterances) P@1 0.510 #1 of 16 Archive leaderboard report
Conversational Response Selection Douban SEMSOL(W/o utterances) R10@1 0.328 #1 of 16 Archive leaderboard report
Conversational Response Selection Douban SEMSOL(W/o utterances) R10@2 0.552 #1 of 16 Archive leaderboard report
Conversational Response Selection Douban SEMSOL(W/o utterances) R10@5 0.877 #1 of 16 Archive leaderboard report
Conversational Response Selection Douban SEMSOL MAP 0.640 #4 of 16 Archive leaderboard report
Conversational Response Selection Douban SEMSOL MRR 0.678 #4 of 16 Archive leaderboard report
Conversational Response Selection Douban SEMSOL P@1 0.511 #4 of 16 Archive leaderboard report
Conversational Response Selection Douban SEMSOL R10@1 0.330 #4 of 16 Archive leaderboard report
Conversational Response Selection Douban SEMSOL R10@2 0.520 #4 of 16 Archive leaderboard report
Conversational Response Selection Douban SEMSOL R10@5 0.870 #4 of 16 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections