The paper ‘The Efficiency Spectrum of Large Language Models: An Algorithmic Survey’ provides a comprehensive review of algorithmic advancements aimed to enhance the efficiency of Large Language Models (LLMs). It covers various topics related to efficiency, including scaling laws, data utilization, architectural innovations, training and tuning strategies, and inference techniques. The paper serves as a valuable resource for researchers and practitioners in the field of artificial intelligence, addressing the computational and memory challenges posed by LLMs.
Publication date: 1 Dec 2023
Project Page: https://arxiv.org/abs/2312.00678v1
Paper: https://arxiv.org/pdf/2312.00678
