pyspark.sql.functions.to_csv

pyspark.sql.functions.to_csv(col: ColumnOrName, options: Optional[Dict[str, str]] = None) → pyspark.sql.column.Column

Converts a column containing a StructType into a CSV string. Throws an exception, in the case of an unsupported type.

Parameters

colColumn or str

name of column containing a struct.

options: dict, optional

options to control converting. accepts the same options as the CSV datasource. See Data Source Option in the version you use.

Examples

>>> from pyspark.sql import Row
>>> data = [(1, Row(age=2, name='Alice'))]
>>> df = spark.createDataFrame(data, ("key", "value"))
>>> df.select(to_csv(df.value).alias("csv")).collect()
[Row(csv='2,Alice')]

previous

pyspark.sql.functions.schema_of_csv

next

pyspark.sql.functions.years