LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs

Taeho Kim, Yanming Wang, Vatshank Chaturvedi, Lokesh Gupta, Seyeon Kim, Yongin Kwon, Sangtae Ha. LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs. In Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, IJCAI 2024, Jeju, South Korea, August 3-9, 2024. pages 6324-6332, ijcai.org, 2024. [doi]

Abstract

Abstract is missing.