AxFormer: Accuracy-driven Approximation of Transformers for Faster, Smaller and more Accurate NLP Models

Amrit Nagarajan, Sanchari Sen, Jacob R. Stevens, Anand Raghunathan. AxFormer: Accuracy-driven Approximation of Transformers for Faster, Smaller and more Accurate NLP Models. In International Joint Conference on Neural Networks, IJCNN 2022, Padua, Italy, July 18-23, 2022. pages 1-8, IEEE, 2022. [doi]

@inproceedings{NagarajanSSR22,
  title = {AxFormer: Accuracy-driven Approximation of Transformers for Faster, Smaller and more Accurate NLP Models},
  author = {Amrit Nagarajan and Sanchari Sen and Jacob R. Stevens and Anand Raghunathan},
  year = {2022},
  doi = {10.1109/IJCNN55064.2022.9892797},
  url = {https://doi.org/10.1109/IJCNN55064.2022.9892797},
  researchr = {https://researchr.org/publication/NagarajanSSR22},
  cites = {0},
  citedby = {0},
  pages = {1-8},
  booktitle = {International Joint Conference on Neural Networks, IJCNN 2022, Padua, Italy, July 18-23, 2022},
  publisher = {IEEE},
  isbn = {978-1-7281-8671-9},
}