ChatGPT’s energy use per query

This article presents a range within which the electricity consumption per query of ChatGPT may fall and compares it to the measured energy consumption of two other large language models (LLMs). This is an interesting undertaking for two reasons: First of all, if organizations know how much electricity ChatGPT requires to answer one question, they can approximate the carbon footprint associated with their use of ChatGPT or similar services such as OpenAI’s LLM APIs. For more than 50,000 European businesses, this may soon become highly relevant, as the coming Corporate Social Responsibility Directive (CSRD) will likely force them to disclose scope 3 emissions in their management reports [1]. I expect usage of services like ChatGPT to fall under scope 3 because cloud compute is considered to be scope 3 [2]. I hope this article can provide inspiration for how to estimate your organization’s scope 3 emissions from ChatGPT and similar services. <a href="https://towardsdatascience.com/chatgpts-energy-use-per-query-9383b8654487">Website</a>