LNS-Madam: Low-Precision Training in Logarithmic Number System Using Multiplicative Weight Update

Jiawei Zhao, Steve Dai, Rangharajan Venkatesan, Brian Zimmer, Mustafa Fayez Ali, Ming-Yu Liu 0001, Brucek Khailany, William J. Dally, Anima Anandkumar. LNS-Madam: Low-Precision Training in Logarithmic Number System Using Multiplicative Weight Update. IEEE Transactions on Computers, 71(12):3179-3190, 2022. [doi]

@article{ZhaoDVZALKDA22,
  title = {LNS-Madam: Low-Precision Training in Logarithmic Number System Using Multiplicative Weight Update},
  author = {Jiawei Zhao and Steve Dai and Rangharajan Venkatesan and Brian Zimmer and Mustafa Fayez Ali and Ming-Yu Liu 0001 and Brucek Khailany and William J. Dally and Anima Anandkumar},
  year = {2022},
  doi = {10.1109/TC.2022.3202747},
  url = {https://doi.org/10.1109/TC.2022.3202747},
  researchr = {https://researchr.org/publication/ZhaoDVZALKDA22},
  cites = {0},
  citedby = {0},
  journal = {IEEE Transactions on Computers},
  volume = {71},
  number = {12},
  pages = {3179-3190},
}