FMMformer: Efficient and Flexible Transformer via Decomposed Near-field and Far-field Attention

Tan M. Nguyen, Vai Suliafu, Stanley J. Osher, Long Chen, Bao Wang. FMMformer: Efficient and Flexible Transformer via Decomposed Near-field and Far-field Attention. In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, Jennifer Wortman Vaughan, editors, Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual. pages 29449-29463, 2021. [doi]

@inproceedings{NguyenSOCW21,
  title = {FMMformer: Efficient and Flexible Transformer via Decomposed Near-field and Far-field Attention},
  author = {Tan M. Nguyen and Vai Suliafu and Stanley J. Osher and Long Chen and Bao Wang},
  year = {2021},
  url = {https://proceedings.neurips.cc/paper/2021/hash/f621585df244e9596dc70a39b579efb1-Abstract.html},
  researchr = {https://researchr.org/publication/NguyenSOCW21},
  cites = {0},
  citedby = {0},
  pages = {29449-29463},
  booktitle = {Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual},
  editor = {Marc'Aurelio Ranzato and Alina Beygelzimer and Yann N. Dauphin and Percy Liang and Jennifer Wortman Vaughan},
}