Package org.apache.beam.runners.spark.structuredstreaming

package org.apache.beam.runners.spark.structuredstreaming

Internal implementation of the Beam runner for Apache Spark.

Related Packages

Package	Description
org.apache.beam.runners.spark	Internal implementation of the Beam runner for Apache Spark.
org.apache.beam.runners.spark.structuredstreaming.examples
org.apache.beam.runners.spark.structuredstreaming.io	Spark-specific transforms for I/O.
org.apache.beam.runners.spark.structuredstreaming.metrics	Provides internal utilities for implementing Beam metrics using Spark accumulators.
org.apache.beam.runners.spark.structuredstreaming.translation	Internal translators for running Beam pipelines on Spark.

Class	Description
SparkStructuredStreamingPipelineOptions	Spark runner PipelineOptions handles Spark execution-related configurations, such as the master address, and other user-related knobs.
SparkStructuredStreamingPipelineResult
SparkStructuredStreamingRunner	A Spark runner build on top of Spark's SQL Engine (Structured Streaming framework).
SparkStructuredStreamingRunnerRegistrar	Contains the PipelineRunnerRegistrar and PipelineOptionsRegistrar for the SparkStructuredStreamingRunner.
SparkStructuredStreamingRunnerRegistrar.Options	Registers the SparkStructuredStreamingPipelineOptions.
SparkStructuredStreamingRunnerRegistrar.Runner	Registers the SparkStructuredStreamingRunner.