inf2 Instance Family
Description #
The Amazon EC2 Inf2 instance family, generally available since April 13, 2023, is designed for deep learning inference and powered by AWS Inferentia2 chips. These instances feature dual AMD EPYC 7R13 processors and offer up to 100 Gbps of networking bandwidth. They provide up to 384 GB of shared accelerator memory and EBS-only storage. Inf2 instances are optimized for generative AI models, delivering high throughput and low latency.
Info #
Instance Types
vCPUs
Up to 192
Memory
Up to 768 GiB
Architecture
x86_64
Processor
AMD
Performance ranking #
Ranked by CPU performance (Passmark)
#11
m1, m2, m3, mac1, mac2, mac-m4, mac2-m2, mac-m4pro, mac2-m2pro, mac2-m1ultra, a1, c1, d2, d3, d3en, dl1, f1, f2, g4ad, g4dn, g5, g5g, g6, g6e, g6f, gr6, gr6f, h1, hpc7g, i2, im4gn, inf1, inf2, is4gen, p3, p3dn, p4d, p4de, p5, p5en, p6-b200, t1, trn1, trn1n, u-3tb1, u-6tb1, vt1, x1, x1e, x2gd, x2idn, x2iedn, x2iezn
Unknown
Up to 448 vCPU
Available Regions #
🇯🇵
ap-northeast-1
🇰🇷
ap-northeast-2
🇮🇳
ap-south-1
🇸🇬
ap-southeast-1
🇦🇺
ap-southeast-2
🇩🇪
eu-central-1
🇸🇪
eu-north-1
🇮🇪
eu-west-1
🇬🇧
eu-west-2
🇫🇷
eu-west-3
🇧🇷
sa-east-1
🇺🇸
us-east-1
🇺🇸
us-east-2
🇺🇸
us-west-2