Papers › Interpreting BERT architecture predictions for peptide presentation by MHC class I proteins

Interpreting BERT architecture predictions for peptide presentation by MHC class I proteins

13 Nov 2021arXiv:2111.07137archive 2025-07-28

Hans-Christof Gasser, Georges Bedran, Bo Ren, David Goodlett, Javier Alfaro, Ajitha Rajan

The major histocompatibility complex (MHC) class-I pathway supports the detection of cancer and viruses by the immune system. It presents parts of proteins (peptides) from inside a cell on its membrane surface enabling visiting immune cells that detect non-self peptides to terminate the cell. The ability to predict whether a peptide will get presented on MHC Class I molecules helps in designing vaccines so they can activate the immune system to destroy the invading disease protein. We designed a prediction model using a BERT-based architecture (ImmunoBERT) that takes as input a peptide and its surrounding regions (N and C-terminals) along with a set of MHC class I (MHC-I) molecules. We present a novel application of well known interpretability techniques, SHAP and LIME, to this domain and we use these results along with 3D structure visualizations and amino acid frequencies to understand and identify the most influential parts of the input amino acid sequences contributing to the output. In particular, we find that amino acids close to the peptides' N- and C-terminals are highly relevant. Additionally, some positions within the MHC proteins (in particular in the A, B and F pockets) are often assigned a high importance ranking - which confirms biological studies and the distances in the structure visualizations.

PaperPDFCode

Code

hcgasser/immunobert officialmentioned in paperpytorch report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

MHC presentation prediction

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

LIMESHAP

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections