self-host →

trn1 EC2 instance family

Intel processor at 3.5 GHz, x86_64, 8 to 128 vCPUs, 32 to 512 GiB, up to 16 × AWS Trainium (32 GiB each)

Linux/UNIX Open trn1 in the finder →
trn1 prices per hour on Linux/UNIX, each type in its cheapest region
Type vCPU Memory Typical spot On-demand Cheapest region Per vCPU-hour
trn1.2xlarge8 vCPU, 32 GiB 8 32 GiB $0.1344 $1.344 us-east-2 of 3 $0.0168
trn1.32xlarge128 vCPU, 512 GiB 128 512 GiB $2.150 $21.50 us-east-2 of 3 $0.0168

Per hour on Linux/UNIX, in each type's cheapest region. Typical spot: per pricing run of the last 7 days, the cheapest zone's spot price, averaged, as the finder shows it with that region selected. On-demand: the same region's price. Per vCPU-hour: the spot price, or without spot the on-demand price, per vCPU. Every region is under Prices by region.

The Trn1 instance family, generally available since October 10, 2022, features an unnamed Intel processor with up to 128 vCPUs, 512 GiB of memory, and dedicated AWS Trainium accelerators. Purpose-built for deep learning training workloads, these instances offer up to 7,600 GB of NVMe SSD instance storage. They provide up to 800 Gbps of network bandwidth and 80 Gbps of EBS bandwidth, facilitating high-throughput data transfer for distributed machine learning tasks.

Written by Gemini from web sources and not checked: the specs and prices on this page come from AWS. Source

Instance Types
vCPUs
8 to 128
Memory
32 to 512 GiB
Architecture
x86_64
Processor vendor
Intel
Sustained clock
3.5 GHz
Accelerators
Up to 16 × AWS Trainium (32 GiB each)
Specs of each type
Type vCPU Memory Accelerator Local storage Network EBS
trn1.2xlarge 8 32 GiB 1 × AWS Trainium (32 GiB) 474 GB NVMe SSD up to 12.5 (3.125 baseline) up to 20 (5 baseline)
trn1.32xlarge 128 512 GiB 16 × AWS Trainium (32 GiB each) 4 × 1900 GB NVMe SSD 800 80

Network and EBS: peak bandwidth in Gbit/s, with the bandwidth the type sustains when it is lower. Local storage: the instance store, in decimal GB as AWS sizes it.

#1
4257
#3
3803 3801–3803
#30
3115 3105–3115
#32
2955 2875–2955
#37
m7i, r7i
2816 2763–2816
#39
2700
#40
2596 2549–2596
#48
2475 2469–2475
#54
2303 2269–2303
#70
2034 1995–2034
#73
1945 1896–1945
#90
m5d
1853
#91
m5dn, c4, r5dn, r5n, t2, t3
1777 1746–1777
#97
m5, m5n, i3en, r5, r5b, r5d
1703 1686–1703
#103
m4, c3, i3
1625 1582–1625
#106
1560 1525–1560
#116
1414 1388–1414
#121
1105 1094–1105

Not benchmarked yet 53

These families have no PassMark single-thread score yet, so they are not ranked.

3 regions with a price in the last 7 days. Select up to 4 to compare them in the price history charts under Prices by region.

Each type's regions on Linux/UNIX, cheapest first, with the same figures as the Prices table, and its price history: the daily mean of every zone and pricing run, over the last 15 UTC days. Each price column is tinted from its cheapest region (green) to its most expensive (red).

trn1.2xlarge8 vCPU, 32 GiB, 3 regions
trn1.2xlarge prices per hour on Linux/UNIX, by region, cheapest first
Region Typical spot On-demand Spot saving
us-east-2 Ohio $0.1344 $1.344 90%
us-west-2 Oregon $0.1910 $1.344 86%
us-east-1 N. Virginia $0.2777 $1.344 79%
Solid: spot, the daily mean of all zones (the typical spot above takes the cheapest zone). Dashed: on-demand. UTC days.
trn1.32xlarge128 vCPU, 512 GiB, 3 regions
trn1.32xlarge prices per hour on Linux/UNIX, by region, cheapest first
Region Typical spot On-demand Spot saving
us-east-2 Ohio $2.150 $21.50 90%
us-west-2 Oregon $3.151 $21.50 85%
us-east-1 N. Virginia $4.883 $21.50 77%
Solid: spot, the daily mean of all zones (the typical spot above takes the cheapest zone). Dashed: on-demand. UTC days.