serverless_gpu.compute

GPU compute type definitions and utilities.

This module defines the available GPU types for serverless compute and provides utilities for working with GPU configurations and resource allocation.

Functions

Classes

GPUType(*values)

Enumeration of available GPU types for serverless compute.

class serverless_gpu.compute.DisplayGpuType(*values)[source]

Bases: Enum

GPU type to Display mapping

a10 = 'A10'

h100_80gb = '8xH100'

class serverless_gpu.compute.GPUType(*values)[source]

Bases: Enum

Enumeration of available GPU types for serverless compute.

This enum defines the GPU types that can be used for distributed computing on the serverless GPU platform.

H100: NVIDIA H100 80GB GPU instances.

A10: NVIDIA A10 GPU instances.

A10 = 'a10'

H100 = 'h100_80gb'

classmethod values()[source]

Get all GPU type values.

Returns:: List of all available GPU type values.
Return type:: List[str]

serverless_gpu.compute.get_display_gpu_type(gpu_type, gpus)[source]

Get the display string for a GPU type given the number of GPUs requested.

Parameters:

gpu_type (GPUType) – The GPU type.
gpus (int) – Total number of GPUs requested.

Returns:

Display string, e.g. “1xH100”, “8xH100”, or “A10”.

Return type:

str