self-host →

p5 EC2 instance family

AMD processor at 3.6 GHz, x86_64, 16 to 192 vCPUs, 256 to 2048 GiB, up to 8 × NVIDIA H100 (80 GiB each)

Open p5 in the finder →
p5 prices per hour on Linux/UNIX, each type in its cheapest region
Type vCPU Memory Typical spot On-demand Cheapest region Per vCPU-hour
p5.4xlarge16 vCPU, 256 GiB 16 256 GiB $1.848 $7.362 eu-north-1 of 10 $0.1155
p5.48xlarge192 vCPU, 2048 GiB 192 2048 GiB $17.36 $63.30 ca-central-1 of 13 $0.0904

Per hour on Linux/UNIX, in each type's cheapest region. Typical spot: per pricing run of the last 7 days, the cheapest zone's spot price, averaged, as the finder shows it with that region selected. On-demand: the same region's price. Per vCPU-hour: the spot price, or without spot the on-demand price, per vCPU. Every region is under Prices by region.

The Amazon EC2 P5 instance family, generally available since July 2023, features NVIDIA H100 Tensor Core GPUs, delivering high performance for deep learning, generative AI, and HPC applications. P5 instances provide up to 3,200 Gbps of networking using the second-generation Elastic Fabric Adapter (EFA) technology. They also offer up to 30 TB of local NVMe storage and are built with 3rd Gen AMD EPYC processors. P5 instances are deployed in EC2 UltraClusters, providing access to exascale supercomputing power.

Written by Gemini from web sources and not checked: the specs and prices on this page come from AWS.

Instance Types
vCPUs
16 to 192
Memory
256 to 2048 GiB
Architecture
x86_64
Processor vendor
AMD
Sustained clock
3.6 GHz
GPUs
Up to 8 × NVIDIA H100 (80 GiB each)
Specs of each type
Type vCPU Memory GPU Local storage Network EBS
p5.4xlarge 16 256 GiB 1 × NVIDIA H100 (80 GiB) 3800 GB NVMe SSD 100 10
p5.48xlarge 192 2048 GiB 8 × NVIDIA H100 (80 GiB each) 8 × 3800 GB NVMe SSD 3200 80

Network and EBS: peak bandwidth in Gbit/s, with the bandwidth the type sustains when it is lower. Local storage: the instance store, in decimal GB as AWS sizes it.

#1
4257
#3
3803 3801–3803
#30
3115 3105–3115
#32
2955 2875–2955
#37
m7i, r7i
2816 2763–2816
#39
2700
#40
2596 2549–2596
#48
2475 2469–2475
#54
2303 2269–2303
#70
2034 1995–2034
#73
1945 1896–1945
#90
m5d
1853
#91
m5dn, c4, r5dn, r5n, t2, t3
1777 1746–1777
#97
m5, m5n, i3en, r5, r5b, r5d
1703 1686–1703
#103
m4, c3, i3
1625 1582–1625
#106
1560 1525–1560
#116
1414 1388–1414
#121
1105 1094–1105

Not benchmarked yet 53

These families have no PassMark single-thread score yet, so they are not ranked.

13 regions with a price in the last 7 days. Select up to 4 to compare them in the price history charts under Prices by region.

Each type's regions on Linux/UNIX, cheapest first, with the same figures as the Prices table, and its price history: the daily mean of every zone and pricing run, over the last 15 UTC days. Each price column is tinted from its cheapest region (green) to its most expensive (red).

p5.4xlarge16 vCPU, 256 GiB, 10 regions
p5.4xlarge prices per hour on Linux/UNIX, by region, cheapest first
Region Typical spot On-demand Spot saving
eu-north-1 Stockholm $1.848 $7.362 75%
us-west-2 Oregon $2.733 $6.880 60%
us-east-2 Ohio $2.971 $6.880 57%
ap-south-1 Mumbai $3.120 $8.256 62%
us-east-1 N. Virginia $3.363 $6.880 51%
ap-southeast-2 Sydney $3.602 $8.944 60%
ap-northeast-1 Tokyo $3.804 $8.600 56%
ap-southeast-3 Jakarta $6.527 $9.494 31%
eu-west-2 London $8.944 $8.944 0%
sa-east-1 São Paulo $9.839 $11.56 15%
Solid: spot, the daily mean of all zones (the typical spot above takes the cheapest zone). Dashed: on-demand. UTC days.
p5.48xlarge192 vCPU, 2048 GiB, 13 regions
p5.48xlarge prices per hour on Linux/UNIX, by region, cheapest first
Region Typical spot On-demand Spot saving
ca-central-1 Canada Central $17.36 $63.30 73%
eu-west-2 London $18.71 $71.55 74%
eu-north-1 Stockholm $19.65 $58.89 67%
ap-south-1 Mumbai $20.94 $66.05 68%
us-west-1 N. California $20.97 $68.80 70%
us-east-2 Ohio $22.10 $55.04 60%
us-west-2 Oregon $22.53 $55.04 59%
ap-northeast-1 Tokyo $24.93 $68.80 64%
us-east-1 N. Virginia $26.41 $55.04 52%
ap-southeast-2 Sydney $26.60 $71.55 63%
ap-northeast-2 Seoul $31.59 $75.96 58%
ap-southeast-3 Jakarta $52.11 $75.96 31%
sa-east-1 São Paulo $78.64 $92.47 15%
Solid: spot, the daily mean of all zones (the typical spot above takes the cheapest zone). Dashed: on-demand. UTC days.