pyspark.streaming.DStream.mapPartitionsWithIndex¶
-
DStream.mapPartitionsWithIndex(f: Callable[[int, Iterable[T]], Iterable[U]], preservesPartitioning: bool = False) → pyspark.streaming.dstream.DStream[U]¶ Return a new DStream in which each RDD is generated by applying mapPartitionsWithIndex() to each RDDs of this DStream.