org.apache.beam.runners.spark.structuredstreaming.translation

Class TranslationContext

java.lang.Object

org.apache.beam.runners.spark.structuredstreaming.translation.AbstractTranslationContext

org.apache.beam.runners.spark.structuredstreaming.translation.TranslationContext

public class TranslationContext
extends AbstractTranslationContext

Subclass of AbstractTranslationContext that address spark breaking changes.

Constructor Summary

Constructors

Constructor and Description
TranslationContext(SparkStructuredStreamingPipelineOptions options)

Method Summary

Modifier and Type	Method and Description
void	launchStreaming(org.apache.spark.sql.streaming.DataStreamWriter<?> dataStreamWriter)

Methods inherited from class org.apache.beam.runners.spark.structuredstreaming.translation.AbstractTranslationContext

emptyDataset, getCurrentTransform, getDataset, getInput, getInputs, getOutput, getOutputCoders, getOutputs, getSerializableOptions, getSideInputDataSet, getSparkSession, printDatasetContent, putDataset, putDatasetWildcard, setCurrentTransform, setSideInputDataset, startPipeline

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TranslationContext

public TranslationContext(SparkStructuredStreamingPipelineOptions options)

Method Detail

launchStreaming

public void launchStreaming(org.apache.spark.sql.streaming.DataStreamWriter<?> dataStreamWriter)

Specified by:

launchStreaming in class AbstractTranslationContext