inf2 EC2 instance family
AMD processor at 3.6 GHz, x86_64, 4 to 192 vCPUs, 16 to 768 GiB, up to 12 × AWS Inferentia2 (32 GiB each)
Prices #
| Type | vCPU | Memory | Typical spot | On-demand | Cheapest region | Per vCPU-hour |
|---|---|---|---|---|---|---|
| inf2.xlarge4 vCPU, 16 GiB | 4 | 16 GiB | $0.0758 | $0.7582 | us-east-2 of 14 | $0.0190 |
| inf2.8xlarge32 vCPU, 128 GiB | 32 | 128 GiB | $0.2165 | $2.165 | eu-north-1 of 13 | $0.00677 |
| inf2.24xlarge96 vCPU, 384 GiB | 96 | 384 GiB | $0.6491 | $6.491 | us-east-2 of 13 | $0.00676 |
| inf2.48xlarge192 vCPU, 768 GiB | 192 | 768 GiB | $1.298 | $12.98 | us-east-2 of 13 | $0.00676 |
Per hour on Linux/UNIX, in each type's cheapest region. Typical spot: per pricing run of the last 7 days, the cheapest zone's spot price, averaged, as the finder shows it with that region selected. On-demand: the same region's price. Per vCPU-hour: the spot price, or without spot the on-demand price, per vCPU. Every region is under Prices by region.
Description #
The Amazon EC2 Inf2 instance family, generally available since April 13, 2023, is designed for deep learning inference and powered by AWS Inferentia2 chips. These instances feature dual AMD EPYC 7R13 processors and offer up to 100 Gbps of networking bandwidth. They provide up to 384 GB of shared accelerator memory and EBS-only storage. Inf2 instances are optimized for generative AI models, delivering high throughput and low latency.
Written by Gemini from web sources and not checked: the specs and prices on this page come from AWS.
Specs #
| Type | vCPU | Memory | Accelerator | Local storage | Network | EBS |
|---|---|---|---|---|---|---|
| inf2.xlarge | 4 | 16 GiB | 1 × AWS Inferentia2 (32 GiB) | EBS only | up to 15 (2.083 baseline) | up to 10 (1.25 baseline) |
| inf2.8xlarge | 32 | 128 GiB | 1 × AWS Inferentia2 (32 GiB) | EBS only | up to 25 (16.667 baseline) | 10 |
| inf2.24xlarge | 96 | 384 GiB | 6 × AWS Inferentia2 (32 GiB each) | EBS only | 50 | 30 |
| inf2.48xlarge | 192 | 768 GiB | 12 × AWS Inferentia2 (32 GiB each) | EBS only | 100 | 60 |
Network and EBS: peak bandwidth in Gbit/s, with the bandwidth the type sustains when it is lower. Local storage: the instance store, in decimal GB as AWS sizes it.
Performance ranking #
Not benchmarked yet 53
These families have no PassMark single-thread score yet, so they are not ranked.
Available Regions #
14 regions with a price in the last 7 days. Select up to 4 to compare them in the price history charts under Prices by region.
Prices by region #
Each type's regions on Linux/UNIX, cheapest first, with the same figures as the Prices table, and its price history: the daily mean of every zone and pricing run, over the last 15 UTC days. Each price column is tinted from its cheapest region (green) to its most expensive (red).
inf2.xlarge4 vCPU, 16 GiB, 14 regions
| Region | Typical spot | On-demand | Spot saving |
|---|---|---|---|
| us-east-2 Ohio | $0.0758 | $0.7582 | 90% |
| eu-north-1 Stockholm | $0.1285 | $0.8340 | 85% |
| sa-east-1 São Paulo | $0.1289 | $1.289 | 90% |
| eu-west-2 London | $0.1316 | $1.137 | 88% |
| ap-northeast-2 Seoul | $0.1540 | $0.9098 | 83% |
| eu-west-3 Paris | $0.1652 | $1.061 | 84% |
| us-east-1 N. Virginia | $0.1817 | $0.7582 | 76% |
| ap-southeast-1 Singapore | $0.1828 | $1.061 | 83% |
| us-west-2 Oregon | $0.1857 | $0.7582 | 76% |
| eu-west-1 Ireland | $0.2300 | $0.9477 | 76% |
| ap-south-1 Mumbai | $0.3340 | $0.9857 | 66% |
| ap-southeast-2 Sydney | $0.3431 | $0.9857 | 65% |
| eu-central-1 Frankfurt | $0.4569 | $1.137 | 60% |
| ap-northeast-1 Tokyo | $0.4962 | $1.137 | 56% |
inf2.8xlarge32 vCPU, 128 GiB, 13 regions
| Region | Typical spot | On-demand | Spot saving |
|---|---|---|---|
| eu-north-1 Stockholm | $0.2165 | $2.165 | 90% |
| us-east-2 Ohio | $0.2204 | $1.968 | 89% |
| sa-east-1 São Paulo | $0.3345 | $3.345 | 90% |
| eu-west-3 Paris | $0.3914 | $2.755 | 86% |
| us-east-1 N. Virginia | $0.4389 | $1.968 | 78% |
| eu-west-2 London | $0.5219 | $2.952 | 82% |
| us-west-2 Oregon | $0.5275 | $1.968 | 73% |
| ap-southeast-1 Singapore | $0.6552 | $2.755 | 76% |
| eu-west-1 Ireland | $0.7529 | $2.460 | 69% |
| ap-south-1 Mumbai | $0.7700 | $2.558 | 70% |
| ap-southeast-2 Sydney | $0.7991 | $2.558 | 69% |
| eu-central-1 Frankfurt | $1.112 | $2.952 | 62% |
| ap-northeast-1 Tokyo | $2.952 | $2.952 | 0% |
inf2.24xlarge96 vCPU, 384 GiB, 13 regions
| Region | Typical spot | On-demand | Spot saving |
|---|---|---|---|
| us-east-2 Ohio | $0.6491 | $6.491 | 90% |
| eu-north-1 Stockholm | $0.7140 | $7.140 | 90% |
| us-east-1 N. Virginia | $0.9264 | $6.491 | 86% |
| eu-west-2 London | $0.9736 | $9.736 | 90% |
| sa-east-1 São Paulo | $1.103 | $11.03 | 90% |
| eu-west-3 Paris | $1.120 | $9.087 | 88% |
| us-west-2 Oregon | $1.489 | $6.491 | 77% |
| ap-southeast-1 Singapore | $1.576 | $9.087 | 83% |
| eu-west-1 Ireland | $1.613 | $8.113 | 80% |
| eu-central-1 Frankfurt | $2.121 | $9.736 | 78% |
| ap-southeast-2 Sydney | $2.576 | $8.438 | 69% |
| ap-south-1 Mumbai | $2.577 | $8.438 | 69% |
| ap-northeast-1 Tokyo | $9.736 | $9.736 | 0% |
inf2.48xlarge192 vCPU, 768 GiB, 13 regions
| Region | Typical spot | On-demand | Spot saving |
|---|---|---|---|
| us-east-2 Ohio | $1.298 | $12.98 | 90% |
| eu-north-1 Stockholm | $1.428 | $14.28 | 90% |
| eu-west-1 Ireland | $1.623 | $16.23 | 90% |
| eu-west-3 Paris | $1.817 | $18.17 | 90% |
| us-west-2 Oregon | $2.028 | $12.98 | 84% |
| sa-east-1 São Paulo | $2.207 | $22.07 | 90% |
| us-east-1 N. Virginia | $2.943 | $12.98 | 77% |
| ap-southeast-1 Singapore | $3.203 | $18.17 | 82% |
| eu-west-2 London | $3.795 | $19.47 | 81% |
| ap-south-1 Mumbai | $5.063 | $16.88 | 70% |
| ap-southeast-2 Sydney | $5.850 | $16.88 | 65% |
| ap-northeast-1 Tokyo | $19.47 | $19.47 | 0% |
| eu-central-1 Frankfurt | $19.47 | $19.47 | 0% |