Understanding AI's energy consumption
Epoch is a research initiative led by Max Schwarzer, focusing on the energy consumption of AI models, particularly ChatGPT. The project aims to provide accurate estimates of the electricity required for processing queries using large language models (LLMs). Recent findings suggest that a typical ChatGPT query using the GPT-4o model consumes approximately 0.3 watt-hours of electricity, significantly lower than previously cited estimates. This reduction is attributed to advancements in model efficiency and hardware. The initiative emphasizes the importance of understanding the environmental impact of AI technologies, while also acknowledging that energy costs may vary based on the complexity of queries and the specific models used. Epoch also engages in discussions about the energy implications of different AI models and their operational requirements.