Momentum Adversarial Distillation: Handling Large Distribution Shifts in Data-Free Knowledge Distillation

Kien Do, Hung Le, Dung Nguyen, Dang Nguyen 0002, Haripriya Harikumar, Truyen Tran 0001, Santu Rana, Svetha Venkatesh. Momentum Adversarial Distillation: Handling Large Distribution Shifts in Data-Free Knowledge Distillation. In Sanmi Koyejo, S. Mohamed, A. Agarwal, Danielle Belgrave, K. Cho, A. Oh, editors, Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 - December 9, 2022. 2022. [doi]

Authors

Kien Do

This author has not been identified. Look up 'Kien Do' in Google

Hung Le

This author has not been identified. Look up 'Hung Le' in Google

Dung Nguyen

This author has not been identified. Look up 'Dung Nguyen' in Google

Dang Nguyen 0002

This author has not been identified. Look up 'Dang Nguyen 0002' in Google

Haripriya Harikumar

This author has not been identified. Look up 'Haripriya Harikumar' in Google

Truyen Tran 0001

This author has not been identified. Look up 'Truyen Tran 0001' in Google

Santu Rana

This author has not been identified. Look up 'Santu Rana' in Google

Svetha Venkatesh

This author has not been identified. Look up 'Svetha Venkatesh' in Google