AI Inference Costs to Surge 5x by 2028

According to a Gartner study, token consumption is continuously increasing as labs become more efficient at developing and deploying more powerful and expensive models, and users expand complex applications such as agent workflows.

These factors are the primary drivers of rising overall inference costs, and Gartner forecasts that inference costs per AI agent workflow will increase more than 5-fold by 2028.