Methods › General › Initialization
Initialization
Initialization methods are used to initialize the weights in a neural network. Below can you find a continuously updating list of initialization methods.
Methods
All 7 methods in this collection, most-tagged first. Year is the archive's introduced_year; the archive stores 2000 when it has none, shown here as “–”. Papers counts distinct papers the archive tags with the method. Click a heading to sort.
| Kaiming Initialization | – | 2,931 |
| Xavier Initialization | – | 121 |
| Fixup Initialization | – | 2 |
| SkipInit | – | 2 |
| T-Fixup | – | 2 |
| LSUV Initialization Layer-Sequential Unit-Variance Initialization | – | 1 |
| ProxyOptimization Proxy Optimization for initial Proxies in Proxy Anchor Loss | – | 1 |