pyspark.RDDBarrier.mapPartitions¶
-
RDDBarrier.mapPartitions(f: Callable[[Iterable[T]], Iterable[U]], preservesPartitioning: bool = False) → pyspark.rdd.RDD[U]¶ Returns a new RDD by applying a function to each partition of the wrapped RDD, where tasks are launched together in a barrier stage. The interface is the same as
RDD.mapPartitions(). Please see the API doc there.Notes
This API is experimental