GPU cloud pricing
Hourly rates for renting GPUs across serverless and dedicated providers. Every number is taken from the vendor's public pricing page — no averages, no estimates. Per-second and per-minute rates are converted to hourly equivalents.
| GPU ↕ | VRAM | RunPod Pods ↕ | RunPod Serverless ↕ | Modal ↕ | Fal.ai ↕ | Baseten ↕ | Replicate ↕ |
|---|---|---|---|---|---|---|---|
| T4 | 16 GB | — | — | $0.59/hr* | — | $0.63/hr* | $0.81/hr* |
| L4 | 24 GB | $0.39/hr | $0.69/hr* | $0.80/hr* | — | $0.85/hr* | — |
| A10 / A10G | 24 GB | — | — | $1.10/hr* | — | $1.21/hr* | — |
| RTX 4090 | 24 GB | $0.69/hr | $1.10/hr | — | — | — | — |
| RTX 5090 | 32 GB | $0.99/hr | $1.58/hr | — | — | — | — |
| RTX A6000 / A40 | 48 GB | $0.44/hr* | $1.22/hr* | — | — | — | — |
| L40S | 48 GB | $0.99/hr | $1.75/hr* | $1.95/hr* | — | — | $3.51/hr* |
| RTX PRO 6000 | 96 GB | $1.99/hr | $3.49/hr | $3.03/hr* | $2.99/hr* | — | — |
| A100 40 GB | 40 GB | — | — | $2.10/hr* | — | — | — |
| A100 80 GB | 80 GB | $1.39/hr* | $2.72/hr | $2.50/hr* | — | $4.00/hr* | $5.04/hr* |
| H100 80 GB | 80 GB | $2.89/hr* | $4.55/hr | $3.95/hr* | $3.99/hr* | $6.50/hr* | $5.49/hr* |
| H200 | 141 GB | $4.39/hr | $5.93/hr | $4.54/hr* | $4.50/hr* | — | — |
| B200 | 180 GB | $5.89/hr | $8.64/hr | $6.25/hr* | $6.25/hr* | $9.98/hr* | — |
| B300 | 288 GB | $7.39/hr | $9.98/hr | $7.10/hr* | $8.50/hr* | — | — |
Green = cheapest listed rate for that GPU. * = hover for the vendor's raw per-second/per-minute rate or a caveat. — = the vendor does not list that GPU publicly.
Sign up (affiliate, same price — some include credit): RunPod +$5 credit · Vultr +$300 trial · DigitalOcean GPU — header links above stay direct, always.
// billing models differ — read this before comparing
- RunPod Pods — per-second, always-on container (Secure Cloud)
- RunPod Serverless — per-second, scale-to-zero workers
- Modal — per-second, scale-to-zero ($30/mo free credit)
- Fal.ai — per-hour list price for custom deployments; committed-use discounts advertised
- Baseten — per-minute, dedicated deployments, scale-to-zero
- Replicate — per-second, private model deployments
// methodology
Prices are read from each vendor's public pricing page and converted to hourly equivalents (per-second × 3600, per-minute × 60), rounded to cents. "As low as" and committed-use rates are noted but never used in the comparison cells. We verify the whole table twice a week and stamp the date above; the raw JSON with source URLs is downloadable. If a number is wrong, the fix is one verification away — tell us.
Want cost per workload instead of cost per hour? Use the LLM hosting cost calculator.
// signing up? these links support HostFleet
The source links in the table always go to official pricing pages, never through us. The signup links below are affiliate links — clearly labeled, same price for you, and some include free credit: