Package org.apache.beam.runners.spark.translation.streaming

Class Checkpoint.CheckpointDir

java.lang.Object

org.apache.beam.runners.spark.translation.streaming.Checkpoint.CheckpointDir

Enclosing class:

Checkpoint

public static class Checkpoint.CheckpointDir
extends Object

Checkpoint dir tree.

SparkPipelineOptions checkpointDir is used as a root directory under which one directory is created for Spark's checkpoint and another for Beam's Spark runner's fault checkpointing needs. Spark's checkpoint relies on Hadoop's FileSystem and is used for Beam as well rather than FileSystem to be consistent with Spark.

Constructor Summary

Constructors

Constructor	Description
CheckpointDir(String rootCheckpointDir)

Method Summary

Modifier and Type	Method	Description
Path	getBeamCheckpointDir()
Path	getRootCheckpointDir()
Path	getSparkCheckpointDir()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

CheckpointDir

public CheckpointDir(String rootCheckpointDir)

Method Details

getRootCheckpointDir

public Path getRootCheckpointDir()

getSparkCheckpointDir

public Path getSparkCheckpointDir()

getBeamCheckpointDir

public Path getBeamCheckpointDir()