TinyFormer: Efficient Sparse Transformer Design and Deployment on Tiny Devices

Jianlei Yang 0001, Jiacheng Liao, Fanding Lei, Meichen Liu, Lingkun Long, Junyi Chen, Han Wan, Bei Yu 0001, Weisheng Zhao 0001. TinyFormer: Efficient Sparse Transformer Design and Deployment on Tiny Devices. IEEE Trans. Circuits Syst. I Regul. Pap., 73(5):3350-3362, May 2026. [doi]

Abstract

Abstract is missing.