HashAttention: Semantic Sparsity for Faster Inference

Aditya Desai, Shuo Yang, Alejandro Cuadron, Matei Zaharia, Joseph E. Gonzalez, Ion Stoica. HashAttention: Semantic Sparsity for Faster Inference. In Forty-second International Conference on Machine Learning, ICML 2025, Vancouver, BC, Canada, July 13-19, 2025. OpenReview.net, 2025. [doi]

@inproceedings{DesaiYCZGS25,
  title = {HashAttention: Semantic Sparsity for Faster Inference},
  author = {Aditya Desai and Shuo Yang and Alejandro Cuadron and Matei Zaharia and Joseph E. Gonzalez and Ion Stoica},
  year = {2025},
  url = {https://openreview.net/forum?id=Em2oaXd8Dc},
  researchr = {https://researchr.org/publication/DesaiYCZGS25},
  cites = {0},
  citedby = {0},
  booktitle = {Forty-second International Conference on Machine Learning, ICML 2025, Vancouver, BC, Canada, July 13-19, 2025},
  publisher = {OpenReview.net},
}