API Reference

This section contains the complete API reference for Serverless GPU API.

• serverless_gpu package
  • Submodules
  • serverless_gpu.asynchronous module
    • get_calls()
    • print_runs()
    • stop()
    • wait()
  • serverless_gpu.compute module
    • GPUType
      • GPUType.H100
      • GPUType.A10
      • GPUType.A10
      • GPUType.H100
      • GPUType.values()
  • serverless_gpu.launcher module
    • distributed()
  • serverless_gpu.runtime module
    • get_global_rank()
    • get_local_rank()
    • get_local_world_size()
    • get_node_rank()
    • get_replica_rank()
    • get_world_size()

Core Modules

serverless_gpu.compute	GPU compute type definitions and utilities.
serverless_gpu.launcher	Main launcher module for distributed serverless GPU compute.
serverless_gpu.runtime	Runtime utilities for distributed serverless GPU compute.
serverless_gpu.asynchronous	Asynchronous execution and monitoring for distributed serverless GPU compute.