Query Encoder Distillation via Embedding Alignment is a Strong Baseline Method to Boost Dense Retriever Online Efficiency

Yuxuan Wang, Hong Lyu. Query Encoder Distillation via Embedding Alignment is a Strong Baseline Method to Boost Dense Retriever Online Efficiency. In Nafise Sadat Moosavi, Iryna Gurevych, Yufang Hou 0001, Gyuwan Kim, Young-Jin Kim, Tal Schuster, Ameeta Agrawal, editors, Proceedings of The Fourth Workshop on Simple and Efficient Natural Language Processing, SustaiNLP 2023, Toronto, Canada (Hybrid), July 13, 2023. pages 290-298, Association for Computational Linguistics, 2023. [doi]

@inproceedings{WangL23-87,
  title = {Query Encoder Distillation via Embedding Alignment is a Strong Baseline Method to Boost Dense Retriever Online Efficiency},
  author = {Yuxuan Wang and Hong Lyu},
  year = {2023},
  url = {https://aclanthology.org/2023.sustainlp-1.23},
  researchr = {https://researchr.org/publication/WangL23-87},
  cites = {0},
  citedby = {0},
  pages = {290-298},
  booktitle = {Proceedings of The Fourth Workshop on Simple and Efficient Natural Language Processing, SustaiNLP 2023, Toronto, Canada (Hybrid), July 13, 2023},
  editor = {Nafise Sadat Moosavi and Iryna Gurevych and Yufang Hou 0001 and Gyuwan Kim and Young-Jin Kim and Tal Schuster and Ameeta Agrawal},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-959429-79-1},
}