A Lightweight Transformer Model using Neural ODE for FPGAs

Ikumi Okubo, Keisuke Sugiura, Hiroki Kawakami, Hiroki Matsutani. A Lightweight Transformer Model using Neural ODE for FPGAs. In IEEE International Parallel and Distributed Processing Symposium, IPDPS 2023 - Workshops, St. Petersburg, FL, USA, May 15-19, 2023. pages 105-112, IEEE, 2023. [doi]

@inproceedings{OkuboSKM23,
  title = {A Lightweight Transformer Model using Neural ODE for FPGAs},
  author = {Ikumi Okubo and Keisuke Sugiura and Hiroki Kawakami and Hiroki Matsutani},
  year = {2023},
  doi = {10.1109/IPDPSW59300.2023.00029},
  url = {https://doi.org/10.1109/IPDPSW59300.2023.00029},
  researchr = {https://researchr.org/publication/OkuboSKM23},
  cites = {0},
  citedby = {0},
  pages = {105-112},
  booktitle = {IEEE International Parallel and Distributed Processing Symposium, IPDPS 2023 - Workshops, St. Petersburg, FL, USA, May 15-19, 2023},
  publisher = {IEEE},
  isbn = {979-8-3503-1199-0},
}