Structured Streaming

This page gives an overview of all public Structured Streaming API.

• Core Classes
  • pyspark.sql.streaming.DataStreamReader
  • pyspark.sql.streaming.DataStreamWriter
  • pyspark.sql.streaming.StreamingQuery
  • pyspark.sql.streaming.StreamingQueryManager
  • pyspark.sql.streaming.StreamingQueryListener
• Input/Output
  • pyspark.sql.streaming.DataStreamReader.csv
  • pyspark.sql.streaming.DataStreamReader.format
  • pyspark.sql.streaming.DataStreamReader.json
  • pyspark.sql.streaming.DataStreamReader.load
  • pyspark.sql.streaming.DataStreamReader.option
  • pyspark.sql.streaming.DataStreamReader.options
  • pyspark.sql.streaming.DataStreamReader.orc
  • pyspark.sql.streaming.DataStreamReader.parquet
  • pyspark.sql.streaming.DataStreamReader.schema
  • pyspark.sql.streaming.DataStreamReader.text
  • pyspark.sql.streaming.DataStreamWriter.foreach
  • pyspark.sql.streaming.DataStreamWriter.foreachBatch
  • pyspark.sql.streaming.DataStreamWriter.format
  • pyspark.sql.streaming.DataStreamWriter.option
  • pyspark.sql.streaming.DataStreamWriter.options
  • pyspark.sql.streaming.DataStreamWriter.outputMode
  • pyspark.sql.streaming.DataStreamWriter.partitionBy
  • pyspark.sql.streaming.DataStreamWriter.queryName
  • pyspark.sql.streaming.DataStreamWriter.start
  • pyspark.sql.streaming.DataStreamWriter.trigger
• Query Management
  • pyspark.sql.streaming.StreamingQuery.awaitTermination
  • pyspark.sql.streaming.StreamingQuery.exception
  • pyspark.sql.streaming.StreamingQuery.explain
  • pyspark.sql.streaming.StreamingQuery.id
  • pyspark.sql.streaming.StreamingQuery.isActive
  • pyspark.sql.streaming.StreamingQuery.lastProgress
  • pyspark.sql.streaming.StreamingQuery.name
  • pyspark.sql.streaming.StreamingQuery.processAllAvailable
  • pyspark.sql.streaming.StreamingQuery.recentProgress
  • pyspark.sql.streaming.StreamingQuery.runId
  • pyspark.sql.streaming.StreamingQuery.status
  • pyspark.sql.streaming.StreamingQuery.stop
  • pyspark.sql.streaming.StreamingQueryManager.active
  • pyspark.sql.streaming.StreamingQueryManager.addListener
  • pyspark.sql.streaming.StreamingQueryManager.awaitAnyTermination
  • pyspark.sql.streaming.StreamingQueryManager.get
  • pyspark.sql.streaming.StreamingQueryManager.removeListener
  • pyspark.sql.streaming.StreamingQueryManager.resetTerminated

previous

pyspark.pandas.extensions.register_index_accessor

next

Core Classes