Breaking the Softmax Bottleneck: A High-Rank RNN Language Model

Zhilin Yang, Zihang Dai, Ruslan Salakhutdinov, William W. Cohen. Breaking the Softmax Bottleneck: A High-Rank RNN Language Model. In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings. OpenReview.net, 2018. [doi]

@inproceedings{YangDSC18-0,
  title = {Breaking the Softmax Bottleneck: A High-Rank RNN Language Model},
  author = {Zhilin Yang and Zihang Dai and Ruslan Salakhutdinov and William W. Cohen},
  year = {2018},
  url = {https://openreview.net/forum?id=HkwZSG-CZ},
  researchr = {https://researchr.org/publication/YangDSC18-0},
  cites = {0},
  citedby = {0},
  booktitle = {6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings},
  publisher = {OpenReview.net},
}