pyspark.sql.DataFrame.distinct

DataFrame.distinct() → pyspark.sql.dataframe.DataFrame

Returns a new DataFrame containing the distinct rows in this DataFrame.

Examples

>>> df.distinct().count()
2

previous

pyspark.sql.DataFrame.describe

next

pyspark.sql.DataFrame.drop