Benchmarking Generative AI Performance Requires a Holistic Approach

Ajay Dholakia, David Ellison, Miro Hodak, Debojyoti Dutta, Carsten Binnig. Benchmarking Generative AI Performance Requires a Holistic Approach. In Raghunath Nambiar, Meikel Poess, editors, Performance Evaluation and Benchmarking: 15th TPC Technology Conference, TPCTC 2023, Vancouver, BC, Canada, August 28 - September 1, 2023, Revised Selected Papers. Volume 14247 of Lecture Notes in Computer Science, pages 34-43, Springer, 2023. [doi]

@inproceedings{DholakiaEHDB23,
  title = {Benchmarking Generative AI Performance Requires a Holistic Approach},
  author = {Ajay Dholakia and David Ellison and Miro Hodak and Debojyoti Dutta and Carsten Binnig},
  year = {2023},
  doi = {10.1007/978-3-031-68031-1_3},
  url = {https://doi.org/10.1007/978-3-031-68031-1_3},
  researchr = {https://researchr.org/publication/DholakiaEHDB23},
  cites = {0},
  citedby = {0},
  pages = {34-43},
  booktitle = {Performance Evaluation and Benchmarking: 15th TPC Technology Conference, TPCTC 2023, Vancouver, BC, Canada, August 28 - September 1, 2023, Revised Selected Papers},
  editor = {Raghunath Nambiar and Meikel Poess},
  volume = {14247},
  series = {Lecture Notes in Computer Science},
  publisher = {Springer},
  isbn = {978-3-031-68030-4},
}