DataConversion

class DataConversion.DataConversion(cols=None, convertTo='', dateTimeFormat='yyyy-MM-dd HH:mm:ss')

Bases: mmlspark.Utils.ComplexParamsMixin, pyspark.ml.util.JavaMLReadable, pyspark.ml.util.JavaMLWritable, pyspark.ml.wrapper.JavaTransformer

Converts the specified list of columns to the specified type. The types are specified by the following strings:

• “boolean”
• “byte”
• “short”
• “integer”
• “long”
• “float”
• “double”
• “string”
• “toCategorical” - make the column be a categorical column
• “clearCategorical” - clear the categorical column
• “date” - the default date format is: “yyyy-MM-dd HH:mm:ss”

Parameters:

• cols (list) – Comma separated list of columns whose type will be converted
• convertTo (str) – The result type (default: )
• dateTimeFormat (str) – Format for DateTime when making DateTime:String conversions (default: yyyy-MM-dd HH:mm:ss)

getCols()

Returns:Comma separated list of columns whose type will be converted Return type:list

getConvertTo()

Returns:The result type (default: ) Return type:str

getDateTimeFormat()

Returns:Format for DateTime when making DateTime:String conversions (default: yyyy-MM-dd HH:mm:ss) Return type:str

static getJavaPackage()

Returns package name String.

classmethod read()

Returns an MLReader instance for this class.

setCols(value)

Parameters:cols (list) – Comma separated list of columns whose type will be converted

setConvertTo(value)

Parameters:convertTo (str) – The result type (default: )

setDateTimeFormat(value)

Parameters:dateTimeFormat (str) – Format for DateTime when making DateTime:String conversions (default: yyyy-MM-dd HH:mm:ss)

setParams(cols=None, convertTo='', dateTimeFormat='yyyy-MM-dd HH:mm:ss')

Set the (keyword only) parameters

Parameters:

• cols (list) – Comma separated list of columns whose type will be converted
• convertTo (str) – The result type (default: )
• dateTimeFormat (str) – Format for DateTime when making DateTime:String conversions (default: yyyy-MM-dd HH:mm:ss)