Beyond Nvidia: AI Infrastructure Diversification Grows

In July, enterprise buyers showed a stronger inclination to evaluate non-Nvidia AI accelerators, with 39.4% planning to explore options like AWS Trainium and Google TPU, compared to 25.3% for Nvidia's upcoming Blackwell GPUs. This marks a strategic move towards diversifying accelerator choices beyond the default Nvidia platform.

Simultaneously, enterprises are prioritizing the expansion and optimization of their current AI infrastructure. This focus means fewer are planning immediate platform changes, despite increased infrastructure activity. Microsoft Azure saw a notable increase in production adoption, rising from 29% to 47.1% among respondents.

Google's Gemini remained the most-used platform, with OpenAI and Anthropic also reporting increased production adoption. Enterprises running their own GPUs are utilizing them more intensively, with under-capacity usage dropping significantly. Effectiveness measures are shifting towards uptime, reliability, and throughput.

This growing operational capability is driving a more demanding set of criteria for AI infrastructure. Performance, cost per million tokens, and access to GPUs are becoming key selection factors, with broad total cost of ownership seeing a decrease in prioritization.

Beyond hardware, enterprises are also looking to maintain architectural control over their AI 'harness' or operational layer. A majority favor approaches that retain control outside of a single model provider, contrasting with a declining trend towards consolidating with one provider's native stack.

Neoclouds, specialized AI infrastructure providers, are also gaining traction. The share of respondents expecting to do more with neoclouds increased, particularly within the technology and software sector, suggesting a growing pipeline for these specialized services.

Open-source AI infrastructure is also experiencing growth, with an increasing number of organizations implementing custom, self-managed open-source stacks. This indicates a deepening adoption within specific market segments, driven by a desire for portability and control, though it also transfers operational responsibilities.