Methods › General › Activation Functions › Margin ReLU
Margin Rectified Linear Unit
Margin ReLU
Introduced by Byeongho Heo et al. in A Comprehensive Overhaul of Feature Distillation
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Margin Rectified Linear Unit, or Margin ReLU, is a type of activation function based on a ReLU, but it has a negative threshold for negative values instead of a zero threshhold.
Papers archive 2025-07-28
2 shown of 2, newest first. Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code; it is per sample and not a correctness claim.
-
DA-Mamba: Domain Adaptive Hybrid Mamba-Transformer Based One-Stage Object Detection 16 Feb 2025 · 2 repositories · arXiv:2502.11178
-
A Comprehensive Overhaul of Feature Distillation 3 Apr 2019 · 2 repositories · arXiv:1904.01866Syntology ran 1 of 6 samples · 5 unverified
Tasks archive 2025-07-28
13 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections