ImputerModel#
- classpyspark.ml.feature.ImputerModel(java_model=None)[source]#
Model fitted by
Imputer.New in version 2.2.0.
Methods
clear(param)Clears a param from the param map if it has been explicitly set.
copy([extra])Creates a copy of this instance with the same uid and some extra params.
explainParam(param)Explains a single param and returns its name, doc, and optional default value and user-supplied value in a string.
Returns the documentation of all params with their optionally default values and user-supplied values.
extractParamMap([extra])Extracts the embedded default param values and user-supplied values, and then merges them with extra values from input into a flat param map, where the latter value is used if there exist conflicts, i.e., with ordering: default param values < user-supplied values < extra.
Gets the value of inputCol or its default value.
Gets the value of inputCols or its default value.
Gets the value of
missingValueor its default value.getOrDefault(param)Gets the value of a param in the user-supplied param map or its default value.
Gets the value of outputCol or its default value.
Gets the value of outputCols or its default value.
getParam(paramName)Gets a param by its name.
Gets the value of relativeError or its default value.
Gets the value of
strategyor its default value.hasDefault(param)Checks whether a param has a default value.
hasParam(paramName)Tests whether this instance contains a param with a given (string) name.
isDefined(param)Checks whether a param is explicitly set by user or has a default value.
isSet(param)Checks whether a param is explicitly set by user.
load(path)Reads an ML instance from the input path, a shortcut ofread().load(path).
read()Returns an MLReader instance for this class.
save(path)Save this ML instance to the given path, a shortcut of 'write().save(path)'.
set(param, value)Sets a parameter in the embedded param map.
setInputCol(value)Sets the value of
inputCol.setInputCols(value)Sets the value of
inputCols.setOutputCol(value)Sets the value of
outputCol.setOutputCols(value)Sets the value of
outputCols.transform(dataset[, params])Transforms the input dataset with optional parameters.
write()Returns an MLWriter instance for this ML instance.
Attributes
Returns all params ordered by name.
Returns a DataFrame containing inputCols and their corresponding surrogates, which are used to replace the missing values in the input DataFrame.
Methods Documentation
- clear(param)#
Clears a param from the param map if it has been explicitly set.
- copy(extra=None)#
Creates a copy of this instance with the same uid and someextra params. This implementation first calls Params.copy andthen make a copy of the companion Java pipeline component withextra params. So both the Python wrapper and the Java pipelinecomponent get copied.
- Parameters
- extradict, optional
Extra parameters to copy to the new instance
- Returns
JavaParamsCopy of this instance
- explainParam(param)#
Explains a single param and returns its name, doc, and optionaldefault value and user-supplied value in a string.
- explainParams()#
Returns the documentation of all params with their optionallydefault values and user-supplied values.
- extractParamMap(extra=None)#
Extracts the embedded default param values and user-suppliedvalues, and then merges them with extra values from input intoa flat param map, where the latter value is used if there existconflicts, i.e., with ordering: default param values <user-supplied values < extra.
- Parameters
- extradict, optional
extra param values
- Returns
- dict
merged param map
- getInputCol()#
Gets the value of inputCol or its default value.
- getInputCols()#
Gets the value of inputCols or its default value.
- getMissingValue()#
Gets the value of
missingValueor its default value.New in version 2.2.0.
- getOrDefault(param)#
Gets the value of a param in the user-supplied param map or itsdefault value. Raises an error if neither is set.
- getOutputCol()#
Gets the value of outputCol or its default value.
- getOutputCols()#
Gets the value of outputCols or its default value.
- getParam(paramName)#
Gets a param by its name.
- getRelativeError()#
Gets the value of relativeError or its default value.
- hasDefault(param)#
Checks whether a param has a default value.
- hasParam(paramName)#
Tests whether this instance contains a param with a given(string) name.
- isDefined(param)#
Checks whether a param is explicitly set by user or hasa default value.
- isSet(param)#
Checks whether a param is explicitly set by user.
- classmethodload(path)#
Reads an ML instance from the input path, a shortcut ofread().load(path).
- classmethodread()#
Returns an MLReader instance for this class.
- save(path)#
Save this ML instance to the given path, a shortcut of ‘write().save(path)’.
- set(param,value)#
Sets a parameter in the embedded param map.
- setOutputCols(value)[source]#
Sets the value of
outputCols.New in version 3.0.0.
- transform(dataset,params=None)#
Transforms the input dataset with optional parameters.
New in version 1.3.0.
- Parameters
- dataset
pyspark.sql.DataFrame input dataset
- paramsdict, optional
an optional param map that overrides embedded params.
- dataset
- Returns
pyspark.sql.DataFrametransformed dataset
- write()#
Returns an MLWriter instance for this ML instance.
Attributes Documentation
- inputCol=Param(parent='undefined',name='inputCol',doc='inputcolumnname.')#
- inputCols=Param(parent='undefined',name='inputCols',doc='inputcolumnnames.')#
- missingValue=Param(parent='undefined',name='missingValue',doc='Theplaceholderforthemissingvalues.AlloccurrencesofmissingValuewillbeimputed.')#
- outputCol=Param(parent='undefined',name='outputCol',doc='outputcolumnname.')#
- outputCols=Param(parent='undefined',name='outputCols',doc='outputcolumnnames.')#
- params#
Returns all params ordered by name. The default implementationuses
dir()to get all attributes of typeParam.
- relativeError=Param(parent='undefined',name='relativeError',doc='therelativetargetprecisionfortheapproximatequantilealgorithm.Mustbeintherange[0,1]')#
- strategy=Param(parent='undefined',name='strategy',doc='strategyforimputation.Ifmean,thenreplacemissingvaluesusingthemeanvalueofthefeature.Ifmedian,thenreplacemissingvaluesusingthemedianvalueofthefeature.Ifmode,thenreplacemissingusingthemostfrequentvalueofthefeature.')#
- surrogateDF#
Returns a DataFrame containing inputCols and their corresponding surrogates,which are used to replace the missing values in the input DataFrame.
New in version 2.2.0.
- uid#
A unique id for the object.