Next-Token Prediction Capacity: General Upper Bounds and a Lower Bound for Transformers

Liam Madden, Curtis Fox, Christos Thrampoulidis. Next-Token Prediction Capacity: General Upper Bounds and a Lower Bound for Transformers. IEEE Transactions on Information Theory, 71(9):7134-7148, September 2025. [doi]

Abstract

Abstract is missing.