Silicon Valley venture capital targets GPU computing power, a16z plans to expand with about 20,000 cards

Multiple venture capital firms in Silicon Valley are competing to secure GPU computing power to provide exclusive resources for their AI startups. a16z established a computing power pool of about 20,000 GPUs as early as 2024 and is negotiating expansion with data center companies Switch and Volta. General Catalyst plans to build a data center for its portfolio companies and has brought in the former head of NVIDIA DGX Cloud in May this year to oversee AI infrastructure operations.

Even if AI startups complete their financing, they may not be able to rent GPUs in a timely manner. In April this year, major cloud providers like Microsoft were reported to prioritize allocating computing power to internal teams and large clients, leaving some startups facing months of waiting. a16z previously disclosed that during times of computing power shortages, prices that could originally be secured with a six-month contract might require a three-year commitment. Model training requires a large amount of GPU usage in a short period, while inference demand is difficult to predict, making it easy to waste funds by locking in computing power for several years in advance.

a16z is concentrating on purchasing and leasing computing power through the Oxygen project, redistributing it to its portfolio companies, allowing them to access prices and contract terms typically reserved for large clients. In August this year, a16z co-led a $300 million financing round for Volta, which is valued at $2.4 billion, with investments covering both AI startups and data center companies providing computing power. The small venture capital firm Crucible Capital has built a cluster with 576 NVIDIA B300 GPUs for its portfolio companies to test, while also selling some computing power to a cutting-edge AI laboratory. This model allows venture capital firms to take on investments that were previously mainly borne by cloud providers and data center operators.