inf1 EC2 instance family
Intel processor at 2.5 GHz, x86_64, 4 to 96 vCPUs, 8 to 192 GiB, up to 16 × AWS Inferentia (8 GiB each)
Prices #
| Type | vCPU | Memory | Typical spot | On-demand | Cheapest region | Per vCPU-hour |
|---|---|---|---|---|---|---|
| inf1.xlarge4 vCPU, 8 GiB | 4 | 8 GiB | $0.0228 | $0.2280 | us-east-2 of 20 | $0.00570 |
| inf1.2xlarge8 vCPU, 16 GiB | 8 | 16 GiB | $0.0385 | $0.3850 | eu-north-1 of 19 | $0.00481 |
| inf1.6xlarge24 vCPU, 48 GiB | 24 | 48 GiB | $0.1254 | $1.254 | eu-north-1 of 19 | $0.00523 |
| inf1.24xlarge96 vCPU, 192 GiB | 96 | 192 GiB | $0.4721 | $4.721 | us-east-2 of 20 | $0.00492 |
Per hour on Linux/UNIX, in each type's cheapest region. Typical spot: per pricing run of the last 7 days, the cheapest zone's spot price, averaged, as the finder shows it with that region selected. On-demand: the same region's price. Per vCPU-hour: the spot price, or without spot the on-demand price, per vCPU. Every region is under Prices by region.
Description #
The INF1 instance family in Amazon EC2 is designed for high-performance, low-cost machine learning inference. These instances, generally available, are powered by AWS Inferentia chips, custom-built by AWS for ML inference, along with 2nd Generation Intel Xeon Scalable processors. INF1 instances offer up to 100 Gbps of networking bandwidth. They do not have instance storage, relying on EBS for storage needs.
Written by Gemini from web sources and not checked: the specs and prices on this page come from AWS.
Specs #
| Type | vCPU | Memory | Accelerator | Local storage | Network | EBS |
|---|---|---|---|---|---|---|
| inf1.xlarge | 4 | 8 GiB | 1 × AWS Inferentia (8 GiB) | EBS only | up to 25 (5 baseline) | up to 4.75 (1.19 baseline) |
| inf1.2xlarge | 8 | 16 GiB | 1 × AWS Inferentia (8 GiB) | EBS only | up to 25 (5 baseline) | up to 4.75 (1.19 baseline) |
| inf1.6xlarge | 24 | 48 GiB | 4 × AWS Inferentia (8 GiB each) | EBS only | 25 | 4.75 |
| inf1.24xlarge | 96 | 192 GiB | 16 × AWS Inferentia (8 GiB each) | EBS only | 100 | 19 |
Network and EBS: peak bandwidth in Gbit/s, with the bandwidth the type sustains when it is lower. Local storage: the instance store, in decimal GB as AWS sizes it.
Performance ranking #
Not benchmarked yet 53
These families have no PassMark single-thread score yet, so they are not ranked.
Available Regions #
20 regions with a price in the last 7 days. Select up to 4 to compare them in the price history charts under Prices by region.
Prices by region #
Each type's regions on Linux/UNIX, cheapest first, with the same figures as the Prices table, and its price history: the daily mean of every zone and pricing run, over the last 15 UTC days. Each price column is tinted from its cheapest region (green) to its most expensive (red).
inf1.xlarge4 vCPU, 8 GiB, 20 regions
| Region | Typical spot | On-demand | Spot saving |
|---|---|---|---|
| us-east-2 Ohio | $0.0228 | $0.2280 | 90% |
| eu-north-1 Stockholm | $0.0242 | $0.2420 | 90% |
| ap-northeast-2 Seoul | $0.0281 | $0.2810 | 90% |
| sa-east-1 São Paulo | $0.0377 | $0.3770 | 90% |
| eu-west-2 London | $0.0379 | $0.2670 | 86% |
| eu-south-1 Milan | $0.0422 | $0.2670 | 84% |
| eu-west-3 Paris | $0.0432 | $0.2670 | 84% |
| us-west-2 Oregon | $0.0434 | $0.2280 | 81% |
| us-west-1 N. California | $0.0447 | $0.2740 | 84% |
| us-east-1 N. Virginia | $0.0469 | $0.2280 | 79% |
| ap-east-1 Hong Kong | $0.0472 | $0.3520 | 87% |
| ca-central-1 Canada Central | $0.0500 | $0.2540 | 80% |
| ap-southeast-1 Singapore | $0.0597 | $0.3080 | 81% |
| ap-northeast-1 Tokyo | $0.0663 | $0.3080 | 78% |
| eu-west-1 Ireland | $0.0688 | $0.2540 | 73% |
| ap-south-1 Mumbai | $0.0715 | $0.2400 | 70% |
| eu-central-1 Frankfurt | $0.0871 | $0.2850 | 69% |
| ap-southeast-2 Sydney | $0.0886 | $0.2850 | 69% |
| me-south-1 Bahrain | no spot | $0.2800 | |
| af-south-1 Cape Town | no spot | $0.3020 |
inf1.2xlarge8 vCPU, 16 GiB, 19 regions
| Region | Typical spot | On-demand | Spot saving |
|---|---|---|---|
| eu-north-1 Stockholm | $0.0385 | $0.3850 | 90% |
| ap-northeast-2 Seoul | $0.0446 | $0.4460 | 90% |
| us-east-2 Ohio | $0.0543 | $0.3620 | 85% |
| sa-east-1 São Paulo | $0.0606 | $0.5980 | 90% |
| ap-east-1 Hong Kong | $0.0690 | $0.5580 | 88% |
| eu-west-2 London | $0.0735 | $0.4240 | 83% |
| us-west-2 Oregon | $0.0745 | $0.3620 | 79% |
| eu-south-1 Milan | $0.0763 | $0.4240 | 82% |
| us-west-1 N. California | $0.0821 | $0.4350 | 81% |
| ca-central-1 Canada Central | $0.0874 | $0.4030 | 78% |
| eu-west-3 Paris | $0.0907 | $0.4230 | 79% |
| us-east-1 N. Virginia | $0.1012 | $0.3620 | 72% |
| ap-southeast-1 Singapore | $0.1047 | $0.4890 | 79% |
| ap-northeast-1 Tokyo | $0.1090 | $0.4890 | 78% |
| ap-south-1 Mumbai | $0.1136 | $0.3810 | 70% |
| eu-west-1 Ireland | $0.1188 | $0.4030 | 71% |
| eu-central-1 Frankfurt | $0.1512 | $0.4530 | 67% |
| ap-southeast-2 Sydney | $0.1566 | $0.4530 | 65% |
| me-south-1 Bahrain | no spot | $0.4440 |
inf1.6xlarge24 vCPU, 48 GiB, 19 regions
| Region | Typical spot | On-demand | Spot saving |
|---|---|---|---|
| eu-north-1 Stockholm | $0.1254 | $1.254 | 90% |
| us-east-2 Ohio | $0.1377 | $1.180 | 88% |
| us-west-1 N. California | $0.1439 | $1.418 | 90% |
| ap-northeast-2 Seoul | $0.1453 | $1.453 | 90% |
| ca-central-1 Canada Central | $0.1704 | $1.315 | 87% |
| eu-west-2 London | $0.1715 | $1.382 | 88% |
| ap-east-1 Hong Kong | $0.1819 | $1.819 | 90% |
| eu-west-3 Paris | $0.1893 | $1.379 | 86% |
| us-west-2 Oregon | $0.1927 | $1.180 | 84% |
| sa-east-1 São Paulo | $0.1950 | $1.950 | 90% |
| us-east-1 N. Virginia | $0.2002 | $1.180 | 83% |
| eu-south-1 Milan | $0.2183 | $1.382 | 84% |
| ap-south-1 Mumbai | $0.2410 | $1.241 | 81% |
| ap-southeast-1 Singapore | $0.2699 | $1.594 | 83% |
| ap-northeast-1 Tokyo | $0.2823 | $1.594 | 82% |
| ap-southeast-2 Sydney | $0.3047 | $1.475 | 79% |
| eu-central-1 Frankfurt | $0.3254 | $1.475 | 78% |
| eu-west-1 Ireland | $0.3557 | $1.315 | 73% |
| me-south-1 Bahrain | no spot | $1.447 |
inf1.24xlarge96 vCPU, 192 GiB, 20 regions
| Region | Typical spot | On-demand | Spot saving |
|---|---|---|---|
| us-east-2 Ohio | $0.4721 | $4.721 | 90% |
| eu-north-1 Stockholm | $0.5016 | $5.016 | 90% |
| us-west-1 N. California | $0.5671 | $5.671 | 90% |
| ap-northeast-2 Seoul | $0.5812 | $5.812 | 90% |
| eu-west-3 Paris | $0.6228 | $5.517 | 89% |
| af-south-1 Cape Town | $0.6249 | $6.249 | 90% |
| eu-west-2 London | $0.6291 | $5.530 | 89% |
| ca-central-1 Canada Central | $0.6546 | $5.260 | 88% |
| ap-south-1 Mumbai | $0.7141 | $4.965 | 86% |
| ap-east-1 Hong Kong | $0.7274 | $7.274 | 90% |
| sa-east-1 São Paulo | $0.7800 | $7.800 | 90% |
| ap-southeast-2 Sydney | $0.8695 | $5.902 | 85% |
| eu-south-1 Milan | $0.8698 | $5.530 | 84% |
| us-east-1 N. Virginia | $0.8829 | $4.721 | 81% |
| eu-central-1 Frankfurt | $1.041 | $5.902 | 82% |
| ap-southeast-1 Singapore | $1.081 | $6.376 | 83% |
| us-west-2 Oregon | $1.117 | $4.721 | 76% |
| ap-northeast-1 Tokyo | $1.128 | $6.376 | 82% |
| eu-west-1 Ireland | $1.281 | $5.260 | 76% |
| me-south-1 Bahrain | no spot | $5.786 |