pyspark.streaming.DStream.join

DStream.join(other: pyspark.streaming.dstream.DStream[Tuple[K, U]], numPartitions: Optional[int] = None) → pyspark.streaming.dstream.DStream[Tuple[K, Tuple[V, U]]]

Return a new DStream by applying ‘join’ between RDDs of this DStream and other DStream.

Hash partitioning is used to generate the RDDs with numPartitions partitions.

previous

pyspark.streaming.DStream.groupByKeyAndWindow

next

pyspark.streaming.DStream.leftOuterJoin