Untangling tradeoffs between recurrence and self-attention in artificial neural networks

Giancarlo Kerg, Bhargav Kanuparthi, Anirudh Goyal, Kyle Goyette, Yoshua Bengio, Guillaume Lajoie. Untangling tradeoffs between recurrence and self-attention in artificial neural networks. In Hugo Larochelle, Marc'Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, Hsuan-Tien Lin, editors, Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual. 2020. [doi]

Authors

Giancarlo Kerg

This author has not been identified. Look up 'Giancarlo Kerg' in Google

Bhargav Kanuparthi

This author has not been identified. Look up 'Bhargav Kanuparthi' in Google

Anirudh Goyal

This author has not been identified. Look up 'Anirudh Goyal' in Google

Kyle Goyette

This author has not been identified. Look up 'Kyle Goyette' in Google

Yoshua Bengio

This author has not been identified. Look up 'Yoshua Bengio' in Google

Guillaume Lajoie

This author has not been identified. Look up 'Guillaume Lajoie' in Google