NanoBERT: An Extremely Compact Language Model

Krishanu Maity, Amit Tulsidas Chaulwar, Vanraj Vala, Ravi Sankar Guntur. NanoBERT: An Extremely Compact Language Model. In Sriraam Natarajan, Indrajit Bhattacharya, Richa Singh 0001, Arun Kumar 0001, Sayan Ranu, Kalika Bali, Abinaya K, editors, Proceedings of the 7th Joint International Conference on Data Science & Management of Data (11th ACM IKDD CODS and 29th COMAD), Bangalore, India, January 4-7, 2024. pages 342-349, ACM, 2024. [doi]

@inproceedings{MaityCVG24,
  title = {NanoBERT: An Extremely Compact Language Model},
  author = {Krishanu Maity and Amit Tulsidas Chaulwar and Vanraj Vala and Ravi Sankar Guntur},
  year = {2024},
  doi = {10.1145/3632410.3632451},
  url = {https://doi.org/10.1145/3632410.3632451},
  researchr = {https://researchr.org/publication/MaityCVG24},
  cites = {0},
  citedby = {0},
  pages = {342-349},
  booktitle = {Proceedings of the 7th Joint International Conference on Data Science & Management of Data (11th ACM IKDD CODS and 29th COMAD), Bangalore, India, January 4-7, 2024},
  editor = {Sriraam Natarajan and Indrajit Bhattacharya and Richa Singh 0001 and Arun Kumar 0001 and Sayan Ranu and Kalika Bali and Abinaya K},
  publisher = {ACM},
}