Home / Technology / AI Agents: 136X More Power Hungry Than You Think
AI Agents: 136X More Power Hungry Than You Think
7 Jul
Summary
- Agentic AI can consume 136.5 times more energy per query.
- AI agents face 153.7 times longer response latency.
- Future AI agent queries could demand half of US electricity.
Research from the Korea Advanced Institute of Science and Technology highlights the substantial energy consumption of agentic AI. These intelligent agents can demand up to 136.5 times more energy per query than generative AI models. This increased demand stems from their need to perform multiple steps, continuously pinging models for reasoning and response generation.
A single query from an agentic AI, running on a large language model, could consume approximately 348.41 watt-hours. This is considerably higher than generative AI queries and can significantly tie up computing resources due to 153.7 times longer response latency. GPUs may sit idle for up to 54.5% of the time.
Agentic AI is already prevalent, with hundreds of thousands of agents registered and integrated into web browsing. Projections suggest that if agentic AI handles query volumes similar to Google Search, it could demand about 198.9 gigawatts of power, potentially consuming half of the United States' current electricity supply without efficiency gains.
