pyspark.RDD.foreachPartition#

RDD.foreachPartition(f)[source]#

Applies a function to each partition of this RDD.

New in version 1.0.0.

Parameters

ffunction

a function applied to each partition

See also

RDD.foreach()

pyspark.sql.DataFrame.foreach()

pyspark.sql.DataFrame.foreachPartition()

Examples

>>>deff(iterator):...forxiniterator:...print(x)...>>>sc.parallelize([1,2,3,4,5]).foreachPartition(f)