Cheap AI Power: 16GB V100 for $699

A 2017 Nvidia Tesla V100 GPU, once a high-end data center card, is now available as a surprisingly affordable option for AI enthusiasts. A new listing on Newegg features the Rmatamini P99S, a compact 5.6-liter PC, equipped with a 16GB Tesla V100, an Intel Core i7-10850H, 16GB RAM, and a 512GB SSD for $699. This configuration offers substantial memory bandwidth, crucial for AI tasks like large language models, at a competitive price point. The V100's 900GB/s memory bandwidth significantly surpasses newer consumer cards. This resurgence in interest for older silicon is driven by the current high cost of memory, which has become the most expensive component in AI builds. However, there are significant caveats. Nvidia's R580 driver branch is the last to support the V100 architecture, meaning newer CUDA versions will not be compatible. While community workarounds exist, the software support window is closing. Additionally, a pricier 32GB version is available for $1,500, offering more memory for demanding applications.