In-Context Denoising with One-Layer Transformers: Connections between Attention and Associative Memory Retrieval

Matthew Smart, Alberto Bietti, Anirvan M. Sengupta. In-Context Denoising with One-Layer Transformers: Connections between Attention and Associative Memory Retrieval. In Forty-second International Conference on Machine Learning, ICML 2025, Vancouver, BC, Canada, July 13-19, 2025. OpenReview.net, 2025. [doi]

@inproceedings{SmartBS25,
  title = {In-Context Denoising with One-Layer Transformers: Connections between Attention and Associative Memory Retrieval},
  author = {Matthew Smart and Alberto Bietti and Anirvan M. Sengupta},
  year = {2025},
  url = {https://openreview.net/forum?id=F08lzoBgad},
  researchr = {https://researchr.org/publication/SmartBS25},
  cites = {0},
  citedby = {0},
  booktitle = {Forty-second International Conference on Machine Learning, ICML 2025, Vancouver, BC, Canada, July 13-19, 2025},
  publisher = {OpenReview.net},
}