Out of the BLEU: How should we assess quality of the Code Generation models?

Mikhail Evtikhiev, Egor Bogomolov, Yaroslav Sokolov, Timofey Bryksin. Out of the BLEU: How should we assess quality of the Code Generation models?. Journal of Systems and Software, 203:111741, September 2023. [doi]

@article{EvtikhievBSB23,
  title = {Out of the BLEU: How should we assess quality of the Code Generation models?},
  author = {Mikhail Evtikhiev and Egor Bogomolov and Yaroslav Sokolov and Timofey Bryksin},
  year = {2023},
  month = {September},
  doi = {10.1016/j.jss.2023.111741},
  url = {https://doi.org/10.1016/j.jss.2023.111741},
  researchr = {https://researchr.org/publication/EvtikhievBSB23},
  cites = {0},
  citedby = {0},
  journal = {Journal of Systems and Software},
  volume = {203},
  pages = {111741},
}