CheckpointData

class CheckpointData.CheckpointData(diskIncluded=False, removeCheckpoint=False)[source]

Bases: mmlspark.Utils.ComplexParamsMixin, pyspark.ml.util.JavaMLReadable, pyspark.ml.util.JavaMLWritable, pyspark.ml.wrapper.JavaTransformer

CheckpointData persists data to disk as well as memory.

Storage level is MEMORY_AND_DISK if true, else MEMORY_ONLY. The default is false (MEMORY_ONLY).

Use the removeCheckpoint parameter to reverse the cache operation.

Parameters:
  • diskIncluded (bool) – Persist to disk as well as memory (default: false)
  • removeCheckpoint (bool) – Unpersist a cached dataset (default: false)
getDiskIncluded()[source]
Returns:Persist to disk as well as memory (default: false)
Return type:bool
static getJavaPackage()[source]

Returns package name String.

getRemoveCheckpoint()[source]
Returns:Unpersist a cached dataset (default: false)
Return type:bool
classmethod read()[source]

Returns an MLReader instance for this class.

setDiskIncluded(value)[source]
Parameters:diskIncluded (bool) – Persist to disk as well as memory (default: false)
setParams(diskIncluded=False, removeCheckpoint=False)[source]

Set the (keyword only) parameters

Parameters:
  • diskIncluded (bool) – Persist to disk as well as memory (default: false)
  • removeCheckpoint (bool) – Unpersist a cached dataset (default: false)
setRemoveCheckpoint(value)[source]
Parameters:removeCheckpoint (bool) – Unpersist a cached dataset (default: false)