Package org.apache.beam.runners.spark.translation.streaming

Class SparkRunnerStreamingContextFactory

java.lang.Object

org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.Function0<org.apache.spark.streaming.api.java.JavaStreamingContext>

public class SparkRunnerStreamingContextFactory
extends Object
implements org.apache.spark.api.java.function.Function0<org.apache.spark.streaming.api.java.JavaStreamingContext>

A JavaStreamingContext factory for resilience.

See Also:

• how-to-configure-checkpointing
• Serialized Form

Constructor Summary

Constructors

Constructor	Description
SparkRunnerStreamingContextFactory(Pipeline pipeline, SparkPipelineOptions options, Checkpoint.CheckpointDir checkpointDir)

Method Summary

Modifier and Type	Method	Description
org.apache.spark.streaming.api.java.JavaStreamingContext	call()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SparkRunnerStreamingContextFactory

public SparkRunnerStreamingContextFactory(Pipeline pipeline,
 SparkPipelineOptions options,
 Checkpoint.CheckpointDir checkpointDir)

Method Details

call

public org.apache.spark.streaming.api.java.JavaStreamingContext call()
                                                              throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function0<org.apache.spark.streaming.api.java.JavaStreamingContext>

Throws:

Exception