Papers › Word-level Human Interpretable Scoring Mechanism for Novel Text Detection Using...

Word-level Human Interpretable Scoring Mechanism for Novel Text Detection Using Tsetlin Machines

10 May 2021arXiv:2105.04708archive 2025-07-28

Bimal Bhattarai, Ole-Christoffer Granmo, Lei Jiao

Recent research in novelty detection focuses mainly on document-level classification, employing deep neural networks (DNN). However, the black-box nature of DNNs makes it difficult to extract an exact explanation of why a document is considered novel. In addition, dealing with novelty at the word-level is crucial to provide a more fine-grained analysis than what is available at the document level. In this work, we propose a Tsetlin machine (TM)-based architecture for scoring individual words according to their contribution to novelty. Our approach encodes a description of the novel documents using the linguistic patterns captured by TM clauses. We then adopt this description to measure how much a word contributes to making documents novel. Our experimental results demonstrate how our approach breaks down novelty into interpretable phrases, successfully measuring novelty.

PaperPDFCode

Code

cair/PyTsetlinMachineCUDA mentioned on GitHub report
cair/TsetlinMachine mentioned on GitHub report
cair/pyTsetlinMachine mentioned on GitHub report
cair/pyTsetlinMachineMT mentioned on GitHub report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Novelty DetectionText Detection

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections