pyspark.sql.DataFrameReader.format

DataFrameReader.format(source: str) → pyspark.sql.readwriter.DataFrameReader

Specifies the input data source format.

Parameters

sourcestr

string, name of the data source, e.g. ‘json’, ‘parquet’.

Examples

>>> df = spark.read.format('json').load('python/test_support/sql/people.json')
>>> df.dtypes
[('age', 'bigint'), ('name', 'string')]

previous

pyspark.sql.DataFrameReader.csv

next

pyspark.sql.DataFrameReader.jdbc