pyspark.sql.DataFrame.union

DataFrame.union(other: pyspark.sql.dataframe.DataFrame) → pyspark.sql.dataframe.DataFrame

Return a new DataFrame containing union of rows in this and another DataFrame.

This is equivalent to UNION ALL in SQL. To do a SQL-style set union (that does deduplication of elements), use this function followed by distinct().

Also as standard in SQL, this function resolves columns by position (not by name).

previous

pyspark.sql.DataFrame.transform

next

pyspark.sql.DataFrame.unionAll