API Reference

This section contains the complete API reference for Serverless GPU API.

• serverless_gpu package
  • Submodules
  • serverless_gpu.compute module
    • DisplayGpuType
      • DisplayGpuType.a10
      • DisplayGpuType.h100_80gb
    • GPUType
      • GPUType.H100
      • GPUType.A10
      • GPUType.A10
      • GPUType.H100
      • GPUType.values()
  • serverless_gpu.launcher module
    • distributed()
  • serverless_gpu.runtime module
    • MissingEnvironmentError
    • get_global_rank()
    • get_local_rank()
    • get_local_world_size()
    • get_node_ip()
    • get_node_rank()
    • get_replica_rank()
    • get_world_size()
  • serverless_gpu.ray module
    • ray_launch()

Core Modules

serverless_gpu.compute	GPU compute type definitions and utilities.
serverless_gpu.launcher	Main launcher module for distributed serverless GPU compute.
serverless_gpu.runtime	Runtime utilities for distributed serverless GPU compute.
serverless_gpu.ray	Ray integration for distributed serverless GPU compute.