Papers › Deep Reinforcement Learning for Dialogue Generation

Deep Reinforcement Learning for Dialogue Generation

5 Jun 2016EMNLP 2016 11arXiv:1606.01541archive 2025-07-28

Jiwei Li, Will Monroe, Alan Ritter, Michel Galley, Jianfeng Gao, Dan Jurafsky

Recent neural models of dialogue generation offer great promise for generating responses for conversational agents, but tend to be shortsighted, predicting utterances one at a time while ignoring their influence on future outcomes. Modeling the future direction of a dialogue is crucial to generating coherent, interesting dialogues, a need which led traditional NLP models of dialogue to draw on reinforcement learning. In this paper, we show how to integrate these goals, applying deep reinforcement learning to model future reward in chatbot dialogue. The model simulates dialogues between two virtual agents, using policy gradient methods to reward sequences that display three useful conversational properties: informativity (non-repetitive turns), coherence, and ease of answering (related to forward-looking function). We evaluate our model on diversity, length as well as with human judges, showing that the proposed algorithm generates more interactive responses and manages to foster a more sustained conversation in dialogue simulation. This work marks a first step towards learning a neural conversational model based on the long-term success of dialogues.

PaperPDFConference PDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

LiangqunLu/DLForChatbot mentioned on GitHubSyntology: not harvested report
tfolkman/deep-learning-experiments mentioned on GitHubpytorchSyntology: not harvested report
zhanghainan/RNN-S2S mentioned on GitHubtfSyntology: not harvested report
zhanghainan/RNN-encdec mentioned on GitHubtfSyntology: not harvested report
zhanghainan/ReinforcingCoherence mentioned on GitHubtfSyntology: not harvested report
zhanghainan/TailoredSeq2Seq2DifferentConversationScenarios mentioned on GitHubtfSyntology: not harvested report
zhanghainan/s2s-with-attention mentioned on GitHubtfSyntology: not harvested report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ChatbotDeep Reinforcement LearningDialogue GenerationDiversityPolicy Gradient MethodsReinforcement LearningReinforcement Learning (RL)reinforcement-learning

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections