DeLighT: Deep and Light-weight Transformer

Sachin Mehta, Marjan Ghazvininejad, Srinivasan Iyer, Luke Zettlemoyer, Hannaneh Hajishirzi. DeLighT: Deep and Light-weight Transformer. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net, 2021. [doi]

@inproceedings{MehtaGIZH21,
  title = {DeLighT: Deep and Light-weight Transformer},
  author = {Sachin Mehta and Marjan Ghazvininejad and Srinivasan Iyer and Luke Zettlemoyer and Hannaneh Hajishirzi},
  year = {2021},
  url = {https://openreview.net/forum?id=ujmgfuxSLrO},
  researchr = {https://researchr.org/publication/MehtaGIZH21},
  cites = {0},
  citedby = {0},
  booktitle = {9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021},
  publisher = {OpenReview.net},
}