Papers › Gated Convolutional Bidirectional Attention-based Model for Off-topic Spoken Response Detection

Gated Convolutional Bidirectional Attention-based Model for Off-topic Spoken Response Detection

20 Apr 2020ACL 2020 6arXiv:2004.09036archive 2025-07-28

Yefei Zha, Ruobing Li, Hui Lin

Off-topic spoken response detection, the task aiming at predicting whether a response is off-topic for the corresponding prompt, is important for an automated speaking assessment system. In many real-world educational applications, off-topic spoken response detectors are required to achieve high recall for off-topic responses not only on seen prompts but also on prompts that are unseen during training. In this paper, we propose a novel approach for off-topic spoken response detection with high off-topic recall on both seen and unseen prompts. We introduce a new model, Gated Convolutional Bidirectional Attention-based Model (GCBiA), which applies bi-attention mechanism and convolutions to extract topic words of prompts and key-phrases of responses, and introduces gated unit and residual connections between major layers to better represent the relevance of responses and prompts. Moreover, a new negative sampling method is proposed to augment training data. Experiment results demonstrate that our novel approach can achieve significant improvements in detecting off-topic responses with extremely high on-topic recall, for both seen and unseen prompts.

PaperPDFConference PDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

zhayefei/off-topic-GCBiA mentioned in papertf report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Machine Reading ComprehensionQuestion AnsweringText Classification

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

Bi-attention

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections