pyspark.SparkContext.setLocalProperty

SparkContext.setLocalProperty(key: str, value: str) → None

Set a local property that affects jobs submitted from this thread, such as the Spark fair scheduler pool.

Notes

If you run jobs in parallel, use pyspark.InheritableThread for thread local inheritance.