pyspark.sql.conf.RuntimeConfig

class pyspark.sql.conf.RuntimeConfig(jconf: py4j.java_gateway.JavaObject)

User-facing configuration API, accessible through SparkSession.conf.

Options set here are automatically propagated to the Hadoop configuration during I/O.

Methods

get(key[, default])

Returns the value of Spark runtime configuration property for the given key, assuming it is set.

isModifiable(key)

Is the configuration property modifiable or not.

set(key, value)

Sets the given Spark runtime configuration property.

unset(key)

Resets the configuration property for the given key.