pyspark.sql.SparkSession.getActiveSession¶

classmethod SparkSession.getActiveSession() → Optional[pyspark.sql.session.SparkSession]¶

Returns the active SparkSession for the current thread, returned by the builder

Returns

SparkSession: Spark session if an active session exists for the current thread

Examples

>>> s = SparkSession.getActiveSession()
>>> l = [('Alice', 1)]
>>> rdd = s.sparkContext.parallelize(l)
>>> df = s.createDataFrame(rdd, ['name', 'age'])
>>> df.select("age").collect()
[Row(age=1)]

pyspark.sql.SparkSession.createDataFrame

pyspark.sql.SparkSession.newSession