Deploy and own NVIDIA RTX PRO 6000 servers
Blackwell with 96 GB per GPU at a fraction of the price. Air-cooled and quick to ship.
RTX PRO 6000 server at a glance
- GPUs
- 8x NVIDIA RTX PRO 6000 Blackwell Server Edition
- GPU memory
- 96 GB GDDR7 per GPU, 768 GB per server
- GPU link
- PCIe Gen 5, no NVLink
- CPUs
- 2x Intel Xeon or AMD EPYC
- Form factor
- Air-cooled, typically 4U-5U
- Power
- About 6-7 kW per server
- Ballpark price
- $100-150K per server
Availability
Most server makers sell RTX PRO 6000 systems, and they usually ship in weeks. They draw about half the power of a B300 server, so far more data centers can host them.
What you need to run RTX PRO 6000s
Power
About 6-7 kW per server. Many standard data centers can host them.
Networking
For a cluster, a 200G or 400G network. Simpler and cheaper than for B300s.
Compliance
Vendors check the buyer, the site, and the use before they ship.
Setup
Racking, cabling, and testing before handover.
We manage. You own.
Scope it
Tell us your budget, timeline, and power. You get a plan and ballpark costs.
One call
We procure it
No preferred vendors. We source servers, networking, and data center space at today’s best price, in your name.
60-90 days typically
We run it
Operations and maintenance (O&M), software, and customers, on an annual contract.
Ongoing
What it costs
Flat fees, not revenue-share.
Paid to vendors, in your name
Hardware
Servers, networking, shipping, and installation, with nothing added.
Colocation
Space, power, and cooling, usually on a 3-year contract.
Parts, bandwidth, and insurance
Spare parts, internet, and property insurance on the hardware.
Paid to us, flat
Setup fee
A flat $25K for 1-7 servers, quoted for 8 or more.
Management fee
From $1K a month per 4 servers.
Want a customer for the GPUs? We charge a small percentage of the contract, only if it signs.
Tell us what you’re planning.
- A call with our CTO about what you need
- Ballpark costs and timelines for your budget
- A straight answer if it’s not a fit
Prefer email? hello@amcompute.com
NVIDIA RTX PRO 6000 servers: questions
- How much does an RTX PRO 6000 server cost?
- Ballpark $100-150K for a new 8-GPU server, before networking, shipping, and the data center.
- RTX PRO 6000 or H200?
- H200 has faster memory and NVLink, so it trains large models better. RTX PRO 6000 costs about a third as much and suits inference, fine-tuning, and graphics.
- Can you train models on RTX PRO 6000?
- Yes, for fine-tuning and smaller models. Without NVLink, large training runs across many GPUs are slower than on HGX servers.
- Does it need liquid cooling?
- No. The servers are air-cooled and draw about 6-7 kW each.
Further reading
More hardware and hosting
- NVIDIA B300 serversBallpark pricing, power, and lead times for HGX B300 servers.
- NVIDIA B200 serversBallpark pricing, power, and availability for HGX B200 servers.
- NVIDIA H200 serversBallpark pricing and availability for HGX H200 servers.
- NVIDIA GB300 NVL72 racksWhat it takes to own a liquid-cooled GB300 NVL72 rack.
- GPU colocationA U.S. data center for the GPU servers you own.
- GPU colocation directoryHigh-density and liquid-cooled data centers by metro: power, kW per rack and liquid cooling, each with a source.
- GPU server vendorsWho sells GPU servers worldwide, from the public partner lists of NVIDIA, Supermicro, Dell, HPE, Lenovo, Cisco, Gigabyte, ASUS and AMD, with server models by maker.
Who it’s for
- AI startupsOwn your GPU servers instead of renting cloud GPUs.
- Universities and research labsA private GPU cluster in your institution’s name, run for you.
- Companies and enterprisesRun AI models on GPU servers your company owns, hosted and run for you.
- Family offices and fundsOwn GPU servers in your own entity and rent them to AI companies.
- Individual investorsOwn one or a few GPU servers through your LLC, rented out and run for you.
