Papers › You Talking to Me? A Corpus and Algorithm for Conversation Disentanglement

You Talking to Me? A Corpus and Algorithm for Conversation Disentanglement

1 Jun 2008archive 2025-07-28

Micha Elsner, Eugene Charniak

When multiple conversations occur simultaneously, a listener must decide which conversation each utterance is part of in order to interpret and respond to it appropriately. We refer to this task as disentanglement. We present a corpus of Internet Relay Chat (IRC) dialogue in which the various conversations have been manually disentangled, and evaluate annotator reliability. This is, to our knowledge, the first such corpus for internet chat. We propose a graph-theoretic model for disentanglement, using discourse-based features which have not been previously applied to this task. The model’s predicted disentanglements are highly correlated with manual annotations.

PaperPDF

Code

No code repository is listed for this paper in the archive or in Syntology's graph.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Conversation DisentanglementDisentanglement

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Conversation Disentanglement Linux IRC (Ch2 Elsner) Linear 1-1 53.1 #1 of 3 Archive leaderboard report
Conversation Disentanglement Linux IRC (Ch2 Elsner) Linear Local 81.9 #1 of 3 Archive leaderboard report
Conversation Disentanglement Linux IRC (Ch2 Elsner) Linear Shen F-1 55.1 #1 of 3 Archive leaderboard report
Conversation Disentanglement Linux IRC (Ch2 Kummerfeld) Linear 1-1 59.7 #1 of 3 Archive leaderboard report
Conversation Disentanglement Linux IRC (Ch2 Kummerfeld) Linear Local 80.8 #1 of 3 Archive leaderboard report
Conversation Disentanglement Linux IRC (Ch2 Kummerfeld) Linear Shen F-1 63.0 #1 of 3 Archive leaderboard report
Conversation Disentanglement irc-disentanglement Linear 1-1 51.4 #4 of 5 Archive leaderboard report
Conversation Disentanglement irc-disentanglement Linear F 15.5 #4 of 5 Archive leaderboard report
Conversation Disentanglement irc-disentanglement Linear P 12.1 #4 of 5 Archive leaderboard report
Conversation Disentanglement irc-disentanglement Linear R 21.5 #4 of 5 Archive leaderboard report
Conversation Disentanglement irc-disentanglement Linear VI 82.1 #4 of 5 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections