Papers › Property Neurons in Self-Supervised Speech Transformers

Property Neurons in Self-Supervised Speech Transformers

7 Sep 2024arXiv:2409.05910archive 2025-07-28

Tzu-Quan Lin, Guan-Ting Lin, Hung-Yi Lee, Hao Tang

There have been many studies on analyzing self-supervised speech Transformers, in particular, with layer-wise analysis. It is, however, desirable to have an approach that can pinpoint exactly a subset of neurons that is responsible for a particular property of speech, being amenable to model pruning and model editing. In this work, we identify a set of property neurons in the feedforward layers of Transformers to study how speech-related properties, such as phones, gender, and pitch, are stored. When removing neurons of a particular property (a simple form of model editing), the respective downstream performance significantly degrades, showing the importance of the property neurons. We apply this approach to pruning the feedforward layers in Transformers, where most of the model parameters are. We show that protecting property neurons during pruning is significantly more effective than norm-based pruning. The code for identifying property neurons is available at https://github.com/nervjack2/PropertyNeurons.

PaperPDFCode

Code

nervjack2/propertyneurons officialmentioned in papermentioned on GitHubpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Model Editing

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

PruningSET

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections