ZerO Initialization: Initializing Neural Networks with only Zeros and Ones

Jiawei Zhao, Florian Schäfer, Anima Anandkumar. ZerO Initialization: Initializing Neural Networks with only Zeros and Ones. Trans. Mach. Learn. Res., 2022, 2022. [doi]

@article{ZhaoSA22-2,
  title = {ZerO Initialization: Initializing Neural Networks with only Zeros and Ones},
  author = {Jiawei Zhao and Florian Schäfer and Anima Anandkumar},
  year = {2022},
  url = {https://openreview.net/forum?id=1AxQpKmiTc},
  researchr = {https://researchr.org/publication/ZhaoSA22-2},
  cites = {0},
  citedby = {0},
  journal = {Trans. Mach. Learn. Res.},
  volume = {2022},
}