Package org.apache.beam.runners.spark.structuredstreaming

Internal implementation of the Beam runner for Apache Spark.

See: Description

Interface Summary

Interface	Description
SparkStructuredStreamingPipelineOptions	Spark runner PipelineOptions handles Spark execution-related configurations, such as the master address, and other user-related knobs.

Class Summary

Class	Description
Constants
SparkStructuredStreamingPipelineResult	Represents a Spark pipeline execution result.
SparkStructuredStreamingRunner	SparkStructuredStreamingRunner is based on spark structured streaming framework and is no more based on RDD/DStream API.
SparkStructuredStreamingRunnerRegistrar	Contains the PipelineRunnerRegistrar and PipelineOptionsRegistrar for the SparkStructuredStreamingRunner.
SparkStructuredStreamingRunnerRegistrar.Options	Registers the SparkStructuredStreamingPipelineOptions.
SparkStructuredStreamingRunnerRegistrar.Runner	Registers the SparkStructuredStreamingRunner.

Package org.apache.beam.runners.spark.structuredstreaming Description

Internal implementation of the Beam runner for Apache Spark.