SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation

Malyaban Bal, Abhronil Sengupta. SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation. In Michael J. Wooldridge, Jennifer G. Dy, Sriraam Natarajan, editors, Thirty-Eigth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada. pages 10998-11006, AAAI Press, 2024. [doi]

Authors

Malyaban Bal

This author has not been identified. Look up 'Malyaban Bal' in Google

Abhronil Sengupta

This author has not been identified. Look up 'Abhronil Sengupta' in Google