pyspark.RDD.collectWithJobGroup

RDD.collectWithJobGroup(groupId: str, description: str, interruptOnCancel: bool = False) → List[T]

When collect rdd, use this method to specify job group.

Use pyspark.InheritableThread with the pinned thread mode enabled.

previous

pyspark.RDD.collectAsMap

next

pyspark.RDD.combineByKey