Inference

Dedicated Compute

Reserved NVIDIA B300 nodes for inference, on GPUs we own.

A per-node spec sheet with five rows: 8 x NVIDIA B300 at 288 GB each, 2 x AMD EPYC 9575F with 3 TB DDR5, 8 x 7.6 TB local NVMe, 8 x 800GbE, and a 12-month minimum term. Below it, a green bar reading $8.50 per GPU-hour, fixed for the term.
CiscoOpenAITalkdeskAmerican Red CrossZillowMicrosoftCosmoIBMState of IowaCiscoOpenAITalkdeskAmerican Red CrossZillowMicrosoftCosmoIBMState of Iowa
THE HARDWARE

B300 nodes on bare metal, reserved for you

Each node is an 8U system built for large-scale inference serving.

  • GPU

    8 x NVIDIA B300 on the NVIDIA HGX platform. 288 GB each, 2.3 TB per node.

  • GPU interconnect

    NVIDIA NVLink with NVSwitch.

  • CPU and memory

    2 x AMD EPYC 9575F, 128 cores per node, with 3 TB of DDR5-6400.

  • Local storage

    8 x 7.6 TB E1.S NVMe SSD, plus 2 x 1.9 TB M.2 NVMe.

  • Network

    8 x 800GbE (XDR800) and 2 x dual-port 200GbE (NDR200).

  • Tenancy and security

    Single-tenant bare metal. Encryption in transit and at rest. SOC 2 Type II.

WHAT IS INCLUDED

What a Dedicated Compute agreement includes

The capacity, the environment around it and the people who run it.

  • Full-node reservation

    Your nodes are yours all day, every day, for the term. There is no daily window and no preemption.

  • Single-tenant bare metal

    No other customer's workload runs on your assigned nodes.

  • Cluster networking

    Eight 800 Gb/s ports on every node, one for each GPU, with RDMA across the cluster.

  • A persistent environment

    Storage volumes, images and network configuration stay in place across the term.

  • Hot-spare node pool

    Spare nodes on hand, with a 4-hour replacement target.

  • A named team

    A named technical account manager, a shared Slack channel and 24/7 engineering support.

PRICING

A public rate, fixed for the term

$8.50 per GPU-hour on NVIDIA B300, on a 12-month minimum agreement. Capacity is reserved for you and billed monthly. Larger commitments and longer terms are quoted by our team.

$8.50

per GPU-hour, 12-month minimum

PRODUCTS

Not ready for a term?

The same GPUs sit behind per-token inference. Start there and move to dedicated nodes when the workload calls for it.

Talk to us about capacity.

Tell us the workload, the GPU count and where it needs to sit. We will come back with a written rate.

Sign up for Telnyx Inference

FAQ

Dedicated Compute is reserved, single-tenant NVIDIA B300 capacity on hardware Telnyx owns and operates. You rent the nodes for a term and they are yours around the clock.