O(n) Connections are Expressive Enough: Universal Approximability of Sparse Transformers

Chulhee Yun, Yin-Wen Chang, Srinadh Bhojanapalli, Ankit Singh Rawat, Sashank J. Reddi, Sanjiv Kumar. O(n) Connections are Expressive Enough: Universal Approximability of Sparse Transformers. In Hugo Larochelle, Marc'Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, Hsuan-Tien Lin, editors, Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual. 2020. [doi]

Authors

Chulhee Yun

This author has not been identified. Look up 'Chulhee Yun' in Google

Yin-Wen Chang

This author has not been identified. Look up 'Yin-Wen Chang' in Google

Srinadh Bhojanapalli

This author has not been identified. Look up 'Srinadh Bhojanapalli' in Google

Ankit Singh Rawat

This author has not been identified. Look up 'Ankit Singh Rawat' in Google

Sashank J. Reddi

This author has not been identified. Look up 'Sashank J. Reddi' in Google

Sanjiv Kumar

This author has not been identified. Look up 'Sanjiv Kumar' in Google