Papers › Distilling Causal Effect from Miscellaneous Other-Class for Continual Named Entity Recognition

Distilling Causal Effect from Miscellaneous Other-Class for Continual Named Entity Recognition

8 Oct 2022arXiv:2210.03980archive 2025-07-28

Junhao Zheng, Zhanxian Liang, Haibin Chen, Qianli Ma

Continual Learning for Named Entity Recognition (CL-NER) aims to learn a growing number of entity types over time from a stream of data. However, simply learning Other-Class in the same way as new entity types amplifies the catastrophic forgetting and leads to a substantial performance drop. The main cause behind this is that Other-Class samples usually contain old entity types, and the old knowledge in these Other-Class samples is not preserved properly. Thanks to the causal inference, we identify that the forgetting is caused by the missing causal effect from the old data. To this end, we propose a unified causal framework to retrieve the causality from both new entity types and Other-Class. Furthermore, we apply curriculum learning to mitigate the impact of label noise and introduce a self-adaptive weight for balancing the causal effects between new entity types and Other-Class. Experimental results on three benchmark datasets show that our method outperforms the state-of-the-art method by a large margin. Moreover, our method can be combined with the existing state-of-the-art methods to improve the performance in CL-NER

PaperPDFCode

In Syntology Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

Code

zzz47zzz/CFNER officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Causal InferenceContinual LearningContinual Named Entity RecognitionFG-1-PG-1MiscellaneousNERNamed Entity RecognitionNamed Entity Recognition (NER)named-entity-recognition

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
FG-1-PG-1 2010 i2b2/VA CFNER F1 (macro) 0.3626 #1 of 1 Archive leaderboard report
FG-1-PG-1 2010 i2b2/VA CFNER F1 (micro) 0.6273 #1 of 1 Archive leaderboard report
FG-1-PG-1 OntoNotes 5.0 CFNER F1 (macro) 0.4222 #1 of 1 Archive leaderboard report
FG-1-PG-1 OntoNotes 5.0 CFNER F1 (micro) 0.5894 #1 of 1 Archive leaderboard report
FG-1-PG-1 conll2003 CFNER F1 (macro) 0.7911 #1 of 1 Archive leaderboard report
FG-1-PG-1 conll2003 CFNER F1 (micro) 0.8091 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections