pyspark.sql.streaming.StreamingQueryManager

class pyspark.sql.streaming.StreamingQueryManager(jsqm: py4j.java_gateway.JavaObject)

A class to manage all the StreamingQuery StreamingQueries active.

Notes

This API is evolving.

Methods

addListener(listener)

Register a StreamingQueryListener to receive up-calls for life cycle events of StreamingQuery.

awaitAnyTermination([timeout])

Wait until any of the queries on the associated SQLContext has terminated since the creation of the context, or since resetTerminated() was called.

get(id)

Returns an active query from this SQLContext or throws exception if an active query with this name doesn’t exist.

removeListener(listener)

Deregister a StreamingQueryListener.

resetTerminated()

Forget about past terminated queries so that awaitAnyTermination() can be used again to wait for new terminations.

Attributes

active

Returns a list of active queries associated with this SQLContext