inf1 Instance Family
Description #
The INF1 instance family in Amazon EC2 is designed for high-performance, low-cost machine learning inference. These instances, generally available, are powered by AWS Inferentia chips, custom-built by AWS for ML inference, along with 2nd Generation Intel Xeon Scalable processors. INF1 instances offer up to 100 Gbps of networking bandwidth. They do not have instance storage, relying on EBS for storage needs.
Info #
Instance Types
vCPUs
Up to 96
Memory
Up to 192 GiB
Architecture
x86_64
Processor
Intel
Performance ranking #
Ranked by CPU performance (Passmark)
#11
a1, c1, d2, d3, d3en, dl1, f1, f2, g4ad, g4dn, g5, g5g, g6, g6e, g6f, gr6, gr6f, h1, hpc7g, i2, im4gn, inf1, inf2, is4gen, m1, m2, m3, mac-m4, mac-m4pro, mac1, mac2, mac2-m1ultra, mac2-m2, mac2-m2pro, p3, p3dn, p4d, p4de, p5, p5en, p6-b200, t1, trn1, trn1n, u-3tb1, u-6tb1, vt1, x1, x1e, x2gd, x2idn, x2iedn, x2iezn
Unknown
Available Regions #
🇿🇦
af-south-1
ðŸ‡ðŸ‡°
ap-east-1
🇯🇵
ap-northeast-1
🇰🇷
ap-northeast-2
🇯🇵
ap-northeast-3
🇮🇳
ap-south-1
🇸🇬
ap-southeast-1
🇦🇺
ap-southeast-2
🇨🇦
ca-central-1
🇩🇪
eu-central-1
🇸🇪
eu-north-1
🇮🇹
eu-south-1
🇮🇪
eu-west-1
🇬🇧
eu-west-2
🇫🇷
eu-west-3
🇧ðŸ‡
me-south-1
🇧🇷
sa-east-1
🇺🇸
us-east-1
🇺🇸
us-east-2
🇺🇸
us-west-1
🇺🇸
us-west-2