AI Data Center Stakeholders

4 min read

Tracking GPU resale prices? , free monthly.

Building AI infrastructure requires 30+ companies. A hyperscaler like Microsoft finances, builds, and operates its own facilities. A neocloud like CoreWeave leases colocation space, raises private credit, and buys GPU servers from OEMs. An enterprise buys through resellers and colocates in someone else's building. Smaller buyers deal with more intermediaries.

Smaller clusters, more middlemenTap any box for details.

100,000+ GPUs

10,000+ GPUs

1,000 GPUs

OEM / ODM

Dell, HPE, Supermicro build standard servers. Foxconn, Quanta build custom designs.

Which stakeholders each project needs

Some stakeholders, like NVIDIA and colo providers, touch every project type. Others are unique to one. Private credit backs neocloud builds but barely exists for the others. The VAR defines enterprise procurement but plays no part at hyperscale.

Who's involved, by project type

Power & Energy

Utility

Hardware Supply Chain

NVIDIA
OEM
ODM
VAR

Finance

Private credit
Equity investor

Construction

General contractor

Infrastructure

Colo provider

Advisory & Operations

Strategy consultant
Tech consultant / SI
Managed services

How a hyperscaler builds a campus

Hyperscaler projects start with power. Securing 100+ MW can take 2-4 years when new substations or transmission lines need to be built. The hyperscaler negotiates directly with the utility, often locking in 10-15 year terms and signing power purchase agreements (PPAs) with renewable energy developers. For example, Microsoft signed a 20-year PPA with Constellation Energy to reopen Three Mile Island's Unit 1 nuclear reactor. [1]Constellation Energy, "Constellation to Launch Crane Clean Energy Center, Restoring Jobs and Carbon-free Power to the Grid" (September 2024). 20-year PPA with Microsoft.https://investors.constellationenergy.com/news-releases/news-release-details/constellation-launch-crane-clean-energy-center-restoring-jobs

Hyperscalers self-finance from operating cash flow and bond issuances. For instance, Microsoft raised $11.5 billion in bonds in October 2024, its largest offering since 2017, partly for AI data center expansion. [2]Bloomberg, "Microsoft Sells $11.5 Billion of Bonds in Year's Biggest Tech Deal" (October 2024) They take no private credit or venture capital, so no external stakeholders impose covenants on GPU utilization rates.

GPU servers are ordered in tens of thousands from OEMs (original equipment manufacturers) like Dell, HPE, and Supermicro, or from ODMs (original design manufacturers) like Foxconn and Quanta that build custom designs. GPU allocation is negotiated directly with NVIDIA.

How a neocloud launches a GPU cloud

Neoclouds occupy other people's buildings and use other people's money. A neocloud relies on every external dependency a hyperscaler might avoid. The neocloud leases space from a colocation provider like Equinix or QTS.

CoreWeave raised $7.5 billion in debt from Blackstone and other lenders, plus $1.1 billion in Series C equity at a $19 billion valuation, in 2024. [3]CNBC, "AI startup CoreWeave raises $7.5 billion in debt, Blackstone leads" (May 2024). Debt facility led by Blackstone, Magnetar, and others.https://www.cnbc.com/2024/05/17/ai-startup-coreweave-raises-7point5-billion-in-debt-blackstone-leads.html [4]CNBC, "Nvidia-backed GPU cloud provider CoreWeave is worth $19 billion" (May 2024). $1.1 billion Series C at $19 billion valuation.https://www.cnbc.com/2024/05/01/nvidia-backed-gpu-cloud-provider-coreweave-is-worth-19-billion.html The debt is collateralized by GPU hardware and forward customer revenue.

GPU supply often limits neoclouds. NVIDIA allocates across customers, and neoclouds compete with hyperscalers who have deeper relationships and larger orders. Lead times for the latest NVIDIA GPUs have ranged from 3-12 months depending on demand cycles. [5]Tom's Hardware / UBS, "Wait times for Nvidia's AI GPUs ease to three to four months" (February 2024). H100 lead times peaked at 8-11 months in late 2023 before improving to 3-4 months.https://www.tomshardware.com/tech-industry/artificial-intelligence/wait-times-for-nvidias-ai-gpus-eases-to-three-to-four-months-suggesting-peak-in-near-term-growth-the-wait-list-for-an-h100-was-previously-eleven-months-ubs NVIDIA still wants to diversify its customer base, so it carves out limited allocation for neoclouds.

How an enterprise deploys AI

Enterprises deploy at the smallest scale and can involve the most intermediaries. Some skip hardware entirely and buy GPU cloud capacity from a hyperscaler or neocloud. The decision depends on data sensitivity, workload predictability, and whether the enterprise has staff to operate GPU infrastructure.

Enterprises that buy hardware often go through a broker or VARs (value-added resellers). For a deployment under 1,000 GPUs, a broker or a VAR is the standard procurement channel. The VAR handles:

  • OEM sourcing and allocation access
  • Enterprise pricing and financing
  • Hardware configuration and testing
  • Logistics and delivery coordination
  • Ongoing support contracts

(Almost) every role in an AI data center project

The roles below cover the major categories but leave some out. Bigger projects tend to add more service providers: environmental consultants, permitting agencies, physical security firms. Smaller projects need fewer of those, but add more intermediaries between themselves and their suppliers: brokers, resellers, and distributors that each add a hop between the GPU and the project.

Every role, and who uses it

NVIDIA

Designs GPUs and networking silicon; sells DGX systems and DGX Cloud

NVIDIA

HyperscalerNeocloudEnterprise

OEM

Manufactures GPU servers by integrating GPUs, power, cooling, and networking

Dell, HPE, Lenovo, Supermicro

HyperscalerNeocloudEnterprise

ODM

Builds custom servers to a customer's specification, without their own brand

Foxconn, Quanta, Wistron

Hyperscaler

VAR

Resells OEM hardware with added services: procurement, financing, configuration, support

WWT, SHI, CDW, Insight

NeocloudEnterprise

Broker

Trades new and used GPU servers on the secondary market

Various independent brokers

Neocloud

ITAD

Handles end-of-life hardware: data destruction, remarketing, recycling

Iron Mountain ITAD, TES, Sims Lifecycle Services

HyperscalerNeocloudEnterprise

Power provider / utility

Supplies grid electricity, builds substation interconnections

Dominion Energy, AES, ERCOT operators

Hyperscaler

Renewable energy producer

Builds solar, wind, or nuclear for long-term power purchase agreements

NextEra Energy, Constellation Energy, AES Clean Energy

Hyperscaler

Colocation provider

Owns the building and provides power distribution, cooling, physical security

Equinix, Digital Realty, QTS, CyrusOne, Vantage

HyperscalerNeocloudEnterprise

Cooling vendor

Supplies liquid cooling systems for high-density GPU racks

Vertiv, CoolIT, GRC, Iceotope

Hyperscaler

General contractor

Builds the physical data center facility

Turner Construction, Holder Construction, DPR

Hyperscaler

DC engineering firm

Designs the facility: power distribution, cooling, structural loading, MEP

HDR, Corgan, Jacobs, Gensler

Hyperscaler

Lender / private credit

Provides debt financing for data center builds and hardware purchases

Blackstone, Apollo, Magnetar, major banks

Neocloud

Equity investor

Provides ownership capital at various stages

Venture capital firms, private equity, infrastructure funds

Neocloud

Financial advisor

Structures debt and equity financing, arranges capital, advises on deal terms

Goldman Sachs, Morgan Stanley, Lazard, Macquarie

HyperscalerNeocloud

Strategy consultant

Advises on AI strategy, build-vs-buy decisions, vendor selection, TCO modeling

McKinsey, BCG, Bain

Enterprise

Tech consultant / SI

Deploys and integrates GPU infrastructure, manages migrations, provides managed services

Accenture, Deloitte, Kyndryl, Wipro

Enterprise

Managed services provider

Remote and on-site IT operations: infrastructure monitoring, patching, incident response, remote hands

Rackspace, Ensono, Park Place Technologies, Flexential

NeocloudEnterprise

Modular DC vendor

Builds prefabricated data center units that ship as containers or modules

Schneider Electric, Vertiv, Celestica

Hyperscaler

Facility operator

Runs day-to-day building operations: power monitoring, cooling management, physical security, maintenance

Often the colo provider; Compass, Aligned, Salute Mission Critical

HyperscalerNeocloudEnterprise

DCIM vendor

Software and sensors for monitoring power, cooling, capacity, and environmental conditions in real time

Nlyte, Sunbird, Device42, Schneider EcoStruxure IT

HyperscalerNeocloudEnterprise

Telco / fiber provider

Provides dark fiber, wavelength services, IP transit, and cross-connects between sites

Zayo, Lumen, regional carriers

HyperscalerNeocloudEnterprise

Site selection consultant

Evaluates locations for power, fiber, water, natural disaster risk, and labor availability

CBRE Site Selection, JLL, Cushman & Wakefield, Biggins Lacy Shapiro

Hyperscaler

Land broker

Finds and transacts raw land for greenfield builds; handles title, survey, and due diligence

CBRE Land, Colliers, local commercial RE brokers

Hyperscaler

Tax incentive consultant

Negotiates tax abatements, enterprise zone benefits, and incentive packages with state and local governments

Crowe, Duff & Phelps (Kroll), various boutique firms

Hyperscaler

Environmental / permitting

Handles environmental impact assessments, zoning applications, and construction permits

AECOM, Tetra Tech, various local firms

Hyperscaler

Commissioning agent

Independently tests and validates electrical, mechanical, and plumbing systems before handover

ESD, RMF Engineering, various specialized firms

Hyperscaler

Insurance broker

Arranges property, equipment, and business interruption coverage for data center assets

Marsh, Aon, Willis Towers Watson

HyperscalerNeocloudEnterprise

Compliance / audit firm

Certifies facilities and operations against standards: SOC 2, ISO 27001, HIPAA, PCI-DSS

Deloitte, EY, Schellman, Coalfire

HyperscalerNeocloudEnterprise

References

  1. Constellation Energy, "Constellation to Launch Crane Clean Energy Center, Restoring Jobs and Carbon-free Power to the Grid" (September 2024). 20-year PPA with Microsoft.
  2. Bloomberg, "Microsoft Sells $11.5 Billion of Bonds in Year's Biggest Tech Deal" (October 2024)
  3. CNBC, "AI startup CoreWeave raises $7.5 billion in debt, Blackstone leads" (May 2024). Debt facility led by Blackstone, Magnetar, and others.
  4. CNBC, "Nvidia-backed GPU cloud provider CoreWeave is worth $19 billion" (May 2024). $1.1 billion Series C at $19 billion valuation.
  5. Tom's Hardware / UBS, "Wait times for Nvidia's AI GPUs ease to three to four months" (February 2024). H100 lead times peaked at 8-11 months in late 2023 before improving to 3-4 months.

Get the Rack Report

Monthly resale prices for GPUs, memory, storage, CPUs and networking. Free by email.

You'll get future issues and occasional updates from us. Unsubscribe anytime.

Frequently Asked Questions

How long does it take a hyperscaler to secure 100+ MW for AI data center power?

Securing 100+ MW can take 2-4 years when new substations or transmission lines need to be built. Hyperscaler projects start with power. The hyperscaler negotiates directly with the utility, often locking in 10-15 year terms and signing power purchase agreements (PPAs) with renewable energy developers.

How do hyperscalers finance AI data center expansion?

Hyperscalers self-finance from operating cash flow and bond issuances. Microsoft raised $11.5 billion in bonds in October 2024, its largest offering since 2017, partly for AI data center expansion. They use no private credit funds and no venture capital.

How did CoreWeave fund its GPU cloud buildout in 2024?

CoreWeave raised $7.5 billion in debt from Blackstone and other lenders, plus $1.1 billion in Series C equity at a $19 billion valuation, in 2024. The debt is collateralized by GPU hardware and forward customer revenue. Neoclouds occupy other people's buildings and use other people's money.

What is the standard procurement channel for an enterprise GPU deployment under 1,000 GPUs?

For a deployment under 1,000 GPUs, a broker or a VAR is the standard procurement channel. Enterprise deployments are the smallest in scale and can involve the most intermediaries. The VAR handles OEM sourcing and allocation access, enterprise pricing and financing, hardware configuration and testing, logistics and delivery coordination, and ongoing support contracts.