When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanism

Guangting Wang, Yucheng Zhao, Chuanxin Tang, Chong Luo, Wenjun Zeng. When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanism. In Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence, IAAI 2022, The Twelveth Symposium on Educational Advances in Artificial Intelligence, EAAI 2022 Virtual Event, February 22 - March 1, 2022. pages 2423-2430, AAAI Press, 2022. [doi]

@inproceedings{WangZTLZ22,
  title = {When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanism},
  author = {Guangting Wang and Yucheng Zhao and Chuanxin Tang and Chong Luo and Wenjun Zeng},
  year = {2022},
  url = {https://ojs.aaai.org/index.php/AAAI/article/view/20142},
  researchr = {https://researchr.org/publication/WangZTLZ22},
  cites = {0},
  citedby = {0},
  pages = {2423-2430},
  booktitle = {Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence, IAAI 2022, The Twelveth Symposium on Educational Advances in Artificial Intelligence, EAAI 2022 Virtual Event, February 22 - March 1, 2022},
  publisher = {AAAI Press},
  isbn = {978-1-57735-876-3},
}