Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture

Daniel Y. Fu, Simran Arora, Jessica Grogan, Isys Johnson, Evan Sabri Eyuboglu, Armin W. Thomas, Benjamin Spector, Michael Poli, Atri Rudra, Christopher Ré. Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture. In Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, Sergey Levine, editors, Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023. 2023. [doi]

@inproceedings{FuAGJETSPRR23,
  title = {Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture},
  author = {Daniel Y. Fu and Simran Arora and Jessica Grogan and Isys Johnson and Evan Sabri Eyuboglu and Armin W. Thomas and Benjamin Spector and Michael Poli and Atri Rudra and Christopher Ré},
  year = {2023},
  url = {http://papers.nips.cc/paper_files/paper/2023/hash/f498c1ce6bff52eb04febf87438dd84b-Abstract-Conference.html},
  researchr = {https://researchr.org/publication/FuAGJETSPRR23},
  cites = {0},
  citedby = {0},
  booktitle = {Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023},
  editor = {Alice Oh and Tristan Naumann and Amir Globerson and Kate Saenko and Moritz Hardt and Sergey Levine},
}