PartitionConsolidator

class PartitionConsolidator.PartitionConsolidator(concurrency=1, concurrentTimeout=100.0, inputCol=None, outputCol=None)[source]

Bases: mmlspark.Utils.ComplexParamsMixin, pyspark.ml.util.JavaMLReadable, pyspark.ml.util.JavaMLWritable, pyspark.ml.wrapper.JavaTransformer

Parameters:
  • concurrency (int) – max number of concurrent calls (default: 1)
  • concurrentTimeout (double) – max number seconds to wait on futures if concurrency >= 1 (default: 100.0)
  • inputCol (str) – The name of the input column
  • outputCol (str) – The name of the output column
getConcurrency()[source]
Returns:max number of concurrent calls (default: 1)
Return type:int
getConcurrentTimeout()[source]
Returns:max number seconds to wait on futures if concurrency >= 1 (default: 100.0)
Return type:double
getInputCol()[source]
Returns:The name of the input column
Return type:str
static getJavaPackage()[source]

Returns package name String.

getOutputCol()[source]
Returns:The name of the output column
Return type:str
classmethod read()[source]

Returns an MLReader instance for this class.

setConcurrency(value)[source]
Parameters:concurrency (int) – max number of concurrent calls (default: 1)
setConcurrentTimeout(value)[source]
Parameters:concurrentTimeout (double) – max number seconds to wait on futures if concurrency >= 1 (default: 100.0)
setInputCol(value)[source]
Parameters:inputCol (str) – The name of the input column
setOutputCol(value)[source]
Parameters:outputCol (str) – The name of the output column
setParams(concurrency=1, concurrentTimeout=100.0, inputCol=None, outputCol=None)[source]

Set the (keyword only) parameters

Parameters:
  • concurrency (int) – max number of concurrent calls (default: 1)
  • concurrentTimeout (double) – max number seconds to wait on futures if concurrency >= 1 (default: 100.0)
  • inputCol (str) – The name of the input column
  • outputCol (str) – The name of the output column