TaskContextwith extra contextual info and tooling for tasks in a barrier stage. Use
BarrierTaskContext.get()to obtain the barrier context for a running barrier task.
This API is experimental
This function blocks until all tasks in the same stage have reached this routine.
Sets a global barrier and waits until all tasks in this stage hit this barrier.
Return the currently active
Get a local property set upstream in the driver, or None if it is missing.
BarrierTaskInfofor all tasks in this barrier stage, ordered by partition ID.
The ID of the RDD partition that is computed by this task.
Resources allocated to the task.
The ID of the stage that this task belong to.
An ID that is unique to this task attempt (within the same SparkContext, no two task attempts will share the same attempt ID).