Transformers Learn Shortcuts to Automata

Bingbin Liu, Jordan T. Ash, Surbhi Goel, Akshay Krishnamurthy, Cyril Zhang. Transformers Learn Shortcuts to Automata. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net, 2023. [doi]

@inproceedings{LiuAGKZ23,
  title = {Transformers Learn Shortcuts to Automata},
  author = {Bingbin Liu and Jordan T. Ash and Surbhi Goel and Akshay Krishnamurthy and Cyril Zhang},
  year = {2023},
  url = {https://openreview.net/pdf?id=De4FYqjFueZ},
  researchr = {https://researchr.org/publication/LiuAGKZ23},
  cites = {0},
  citedby = {0},
  booktitle = {The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023},
  publisher = {OpenReview.net},
}