SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation

Malyaban Bal, Abhronil Sengupta. SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation. In Michael J. Wooldridge, Jennifer G. Dy, Sriraam Natarajan, editors, Thirty-Eigth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada. pages 10998-11006, AAAI Press, 2024. [doi]

@inproceedings{BalS24,
  title = {SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation},
  author = {Malyaban Bal and Abhronil Sengupta},
  year = {2024},
  doi = {10.1609/aaai.v38i10.28975},
  url = {https://doi.org/10.1609/aaai.v38i10.28975},
  researchr = {https://researchr.org/publication/BalS24},
  cites = {0},
  citedby = {0},
  pages = {10998-11006},
  booktitle = {Thirty-Eigth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada},
  editor = {Michael J. Wooldridge and Jennifer G. Dy and Sriraam Natarajan},
  publisher = {AAAI Press},
}