AMD Instinct™ MI355X GPU - Vultr.com
AMD Instinct MI355X

AMD Instinct MI355X GPUs deliver exceptional acceleration for high performance computing and AI. Built with 288 GB HBM3E memory and up to 8 TB/s memory bandwidth, AMD Instinct MI355X GPUs handle larger models with fewer GPUs. With support for FP4 and FP6 datatypes, AMD Instinct MI355X GPUs maximize computational throughput, energy efficiency, and memory bandwidth for faster AI inference. The MI355X GPUs’ 4th Gen AMD CDNA™ architecture enhances performance for training massive AI models, AI inference, and complex HPC workloads such as modeling and scientific simulations.

AMD Instinct™ MI355X
Coming soon...
Reserve now

Download
Delivering inference-optimized efficiency and excelling at HPC and AI training workloads

Process more data in-memory for greater efficiency and high performance.

No information is required for download

Enterprise-ready at
any scale and any location

Clusters at any size

Vultr's enterprise-ready infrastructure seamlessly supports any cluster size of AMD Instinct™ GPUs. Whether you require a small cluster or a massive deployment, Vultr ensures reliable, high-performance computing to meet your specific needs.

Get in touch

Globally available, locally accessible

Large clusters of AMD Instinct™ GPUs are available where you need them, thanks to Vultr's extensive infrastructure. With 32 cloud data center regions across six continents, we guarantee low latency and high availability, enabling your enterprise to achieve optimal performance worldwide.

Learn more

Enterprise-grade compliance and security

Vultr ensures our platform, products, and services meet diverse global compliance, privacy, and security needs, covering areas such as server availability, data protection, and privacy. Our commitment to industry-wide privacy and security frameworks demonstrates our dedication to protecting our customers' data.

Learn more

Powered by AMD ROCm™
open software ecosystem

AMD ROCm™ is the only open software platform for GPU computing, ensuring freedom from vendor lock-in and from limited architectural options.

AMD ROCm™ works out of the box and is supported on hundreds of open-source platforms, letting developers design the solutions they need to advance their models without the concerns of being locked into a proprietary solution.

Illustration of the AMD ROCm™ open software ecosystem. This includes an AI ecosystem optimized for AMD with PyTorch and other frameworks; a proven software stack including libraries, compilers, tools, and runtime; and AMD Instinct™ GPU Leadership performance.

AMD Instinct MI355X Platform

Specifications

AMD Instinct MI355X GPUs
8
Form factor
UBB 2.0 module
GPU compute units
2048
Matrix cores
8192
Peak engine clock
2200 MHz
Memory capacity
Up to 288 GB HBM3E per GPU
Memory bandwidth
8.0 TB/s max. peak theoretical per GPU
Memory interface
8192 bits
AMD Infinity Cache™ (last level)
256 MB per GPU

AI peak theoretical performance

with sparsity
FP16 (PFLOPs)
20.1
40.3
BFLOAT16 (PFLOPs)
20.1
40.3
INT8 (PFLOPs)
40.3
80.5
INT4 (POPs)
40.3
80.5
FP8 (PFLOPs)
40.3
80.5
FP6 (PFLOPs)
80.5
161.1
FP4 (PFLOPs)
80.5
161.1

HPC peak theoretical performance

(TFLOPS)
FP64 vector
628.8
FP32 vector
1.3
FP64 matrix
628.8
FP32 matrix
1.3

Customer success stories and use cases

Explore how leading organizations in the manufacturing and energy industry, equipped with the right tools, achieve security, connectivity, and efficiency using Vultr’s cloud solutions.

Hybrid cloud connectivity for IoT image processing
Connected drones capture real-time data from oil fields, processed locally by Gravio for anomaly detection. Data is securely transmitted via Console Connect to Vultr’s high-performance cloud, enabling AI workflows for insights, trend detection, and alerts.
Learn more
Asset management in the oil and gas sector
Harness Vultr, AMD GPUs, digital twins, and drones to optimize asset management in oil and gas. Enable real-time monitoring, predictive maintenance, and operational efficiency to reduce costs and boost performance.
Learn more
Real-time analytics for manufacturing and energy
HEAVY.AI on Vultr delivers real-time analytics for manufacturing and energy. It optimizes routes in logistics, enhances safety in automotive telematics, and drives efficiency in energy through well planning and pipeline management.
Learn more

"At ConfidentialMind, we specialize in deploying generative AI applications and agents in on-premises and private cloud environments. With Vultr Cloud GPUs, including the AMD Instinct™ MI300X, we harness the computational power needed to train and run complex language models. Vultr Kubernetes Engine streamlines deployment and scaling across on-prem, private cloud, and edge environments. Vultr’s infrastructure delivers the performance, scalability, and data security that enable our customers to create and deploy AI applications tailored to their unique needs without compromising data sovereignty or operational efficiency."

Severi Tikkala
CTO at ConfidentialMind

Access advanced hardware without the typical complexities

Discover how Vultr's integration of AMD Instinct MI355X GPUs is reshaping what's possible for AI and HPC in the cloud. This IDC report explores the strategic impact of Vultr’s partnership with AMD, the advantages of cutting-edge GPU architecture, and what it means for developers, enterprises, and innovators alike.

No information is required for download

Vultr to Offer AMD Instinct MI355X GPUs for AI and HPC Workloads
Download

Reserve AMD Instinct™
MI355X GPUs now

Get ready to build, test, and deploy on The Everywhere Cloud.

Reserve now