Package org.apache.beam.sdk

@DefaultAnnotation(org.checkerframework.checker.nullness.qual.NonNull.class) package org.apache.beam.sdk

Provides a simple, powerful model for building both batch and streaming parallel data processing Pipelines.

To use the Apache Beam SDK, you build a Pipeline, which manages a graph of PTransforms and the PCollections that the PTransforms consume and produce.

Each Pipeline has a PipelineRunner to specify where and how it should run after pipeline construction is complete.

Related Packages

Package	Description
org.apache.beam.sdk.annotations	Defines annotations used across the SDK.
org.apache.beam.sdk.coders	Defines Coders to specify how data is encoded to and decoded from byte strings.
org.apache.beam.sdk.expansion	Contains classes needed to expose transforms to other SDKs.
org.apache.beam.sdk.fn	The top level package for the Fn Execution Java libraries.
org.apache.beam.sdk.function	Java 8 functional interface extensions.
org.apache.beam.sdk.harness	Utilities for configuring worker environment.
org.apache.beam.sdk.io	Defines transforms for reading and writing common storage formats, including invalid reference org.apache.beam.sdk.io.AvroIO , and TextIO.
org.apache.beam.sdk.managed	Managed reads and writes.
org.apache.beam.sdk.metrics	Metrics allow exporting information about the execution of a pipeline.
org.apache.beam.sdk.options	Defines PipelineOptions for configuring pipeline execution.
org.apache.beam.sdk.providers	Defines SchemaTransformProviders for transforms in the core module.
org.apache.beam.sdk.schemas	Defines Schema and other classes for representing schema'd data in a Pipeline.
org.apache.beam.sdk.state	Classes and interfaces for interacting with state.
org.apache.beam.sdk.testing	Defines utilities for unit testing Apache Beam pipelines.
org.apache.beam.sdk.transforms	Defines PTransforms for transforming data in a pipeline.
org.apache.beam.sdk.values	Defines PCollection and other classes for representing data in a Pipeline.

Class	Description
Pipeline	A Pipeline manages a directed acyclic graph of PTransforms, and the PCollections that the PTransforms consume and produce.
Pipeline.PipelineExecutionException	Thrown during execution of a Pipeline, whenever user code within that Pipeline throws an exception.
Pipeline.PipelineVisitor	For internal use only; no backwards-compatibility guarantees.
Pipeline.PipelineVisitor.CompositeBehavior	Control enum for indicating whether or not a traversal should process the contents of a composite transform or not.
Pipeline.PipelineVisitor.Defaults	Default no-op Pipeline.PipelineVisitor that enters all composite transforms.
PipelineResult	Result of Pipeline.run().
PipelineResult.State	Possible job states, for both completed and ongoing jobs.
PipelineRunner<ResultT extends PipelineResult>	A PipelineRunner runs a Pipeline.