Lost in the Middle: How Language Models Use Long Contexts

Nelson F. Liu, Kevin Lin, John Hewitt, Ashwin Paranjape, Michele Bevilacqua, Fabio Petroni, Percy Liang. Lost in the Middle: How Language Models Use Long Contexts. TACL, 12:157-173, 2024. [doi]

@article{LiuLHPBPL24a,
  title = {Lost in the Middle: How Language Models Use Long Contexts},
  author = {Nelson F. Liu and Kevin Lin and John Hewitt and Ashwin Paranjape and Michele Bevilacqua and Fabio Petroni and Percy Liang},
  year = {2024},
  doi = {10.1162/tacl_a_00638},
  url = {https://doi.org/10.1162/tacl_a_00638},
  researchr = {https://researchr.org/publication/LiuLHPBPL24a},
  cites = {0},
  citedby = {0},
  journal = {TACL},
  volume = {12},
  pages = {157-173},
}