Select your Flavor

When to choose GPU or CPU flavors?

According to your needs, you can choose from two options: CPU and GPU Flavors.

When to choose GPU Flavor?

GPU Flavor is ideal for inference of complex deep learning models, image processing, or multimedia content generation.

When to choose GPU flavor?

CPU Flavor is more dedicated to light tasks as simple text processing algorithms or structured data processing, that do not require a very low latency time.

Which GPU Flavors are available for AI Inference?

NVIDIA L40S

GPU specialized for inference tasks able to accelerate multiple workloads.

NVIDIA H100 TensorCore

Up to 30 times acceleration of LLM processing. Ideal for complete models with up to 30 billion parameters.

NVIDIA A100 TensorCore

A100 provide up to 20X higher performance over the NVIDIA Volta with zero code changes and an additional 2X boost with automatic mixed precision and FP16