Lite Transformer with Long-Short Range Attention

Zhanghao Wu, Zhijian Liu, Ji Lin, Yujun Lin, Song Han. Lite Transformer with Long-Short Range Attention. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.net, 2020. [doi]

@inproceedings{WuLLLH20,
  title = {Lite Transformer with Long-Short Range Attention},
  author = {Zhanghao Wu and Zhijian Liu and Ji Lin and Yujun Lin and Song Han},
  year = {2020},
  url = {https://openreview.net/forum?id=ByeMPlHKPH},
  researchr = {https://researchr.org/publication/WuLLLH20},
  cites = {0},
  citedby = {0},
  booktitle = {8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020},
  publisher = {OpenReview.net},
}