Attention Approximates Sparse Distributed Memory

Trenton Bricken, Cengiz Pehlevan. Attention Approximates Sparse Distributed Memory. In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, Jennifer Wortman Vaughan, editors, Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual. pages 15301-15315, 2021. [doi]

@inproceedings{BrickenP21,
  title = {Attention Approximates Sparse Distributed Memory},
  author = {Trenton Bricken and Cengiz Pehlevan},
  year = {2021},
  url = {https://proceedings.neurips.cc/paper/2021/hash/8171ac2c5544a5cb54ac0f38bf477af4-Abstract.html},
  researchr = {https://researchr.org/publication/BrickenP21},
  cites = {0},
  citedby = {0},
  pages = {15301-15315},
  booktitle = {Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual},
  editor = {Marc'Aurelio Ranzato and Alina Beygelzimer and Yann N. Dauphin and Percy Liang and Jennifer Wortman Vaughan},
}