pyspark.resource.ExecutorResourceRequests¶
-
class
pyspark.resource.ExecutorResourceRequests(_jvm: Optional[py4j.java_gateway.JVMView] = None, _requests: Optional[Dict[str, pyspark.resource.requests.ExecutorResourceRequest]] = None)¶ A set of Executor resource requests. This is used in conjunction with the
pyspark.resource.ResourceProfileBuilderto programmatically specify the resources needed for an RDD that will be applied at the stage level.Notes
This API is evolving.
Methods
cores(amount)memory(amount)memoryOverhead(amount)offheapMemory(amount)pysparkMemory(amount)resource(resourceName, amount[, …])Attributes
requests