pyspark.streaming.DStream.checkpoint

DStream.checkpoint(interval: int) → pyspark.streaming.dstream.DStream[T]

Enable periodic checkpointing of RDDs of this DStream

Parameters

intervalint

time in seconds, after each period of that, generated RDD will be checkpointed

previous

pyspark.streaming.DStream.cache

next

pyspark.streaming.DStream.cogroup