BaseReadWrite#

classpyspark.ml.util.BaseReadWrite[source]#

Base class for MLWriter and MLReader. Stores information about the SparkContextand SparkSession.

New in version 2.3.0.

Methods

session(sparkSession)

Sets the Spark Session to use for saving/loading.

Attributes

sc	Returns the underlyingSparkContext.
sparkSession	Returns the user-specified Spark Session or the default.

Methods Documentation

session(sparkSession)[source]#

Sets the Spark Session to use for saving/loading.

Attributes Documentation

sc#

Returns the underlyingSparkContext.

sparkSession#

Returns the user-specified Spark Session or the default.