Package org.apache.beam.runners.dataflow.internal

package org.apache.beam.runners.dataflow.internal

Implementation of the DataflowRunner.

Related Packages

Package	Description
org.apache.beam.runners.dataflow	Provides a Beam runner that executes pipelines on the Google Cloud Dataflow service.
org.apache.beam.runners.dataflow.options	Provides PipelineOptions specific to Google Cloud Dataflow.
org.apache.beam.runners.dataflow.util	Provides miscellaneous internal utilities used by the Google Cloud Dataflow runner.

Classes

Class	Description
CustomSources	A helper class for supporting sources defined as Source.
DataflowGroupByKey<K,V>	Specialized implementation of GroupByKey for translating Redistribute transform into Dataflow service protos.
DataflowGroupByKey.Registrar	Registers DataflowGroupByKey.DataflowGroupByKeyTranslator.
IsmFormat	An Ism file is a prefix encoded composite key value file broken into shards.
IsmFormat.Footer	The footer stores the relevant information required to locate the index and bloom filter.
IsmFormat.FooterCoder	A Coder for IsmFormat.Footer.
IsmFormat.IsmRecord<V>	A record containing a composite key and either a value or metadata.
IsmFormat.IsmRecordCoder<V>	A Coder for IsmFormat.IsmRecords.
IsmFormat.IsmShard	A shard descriptor containing shard id, the data block offset, and the index offset for the given shard.
IsmFormat.IsmShardCoder	A coder for IsmFormat.IsmShards.
IsmFormat.KeyPrefix	The prefix used before each key which contains the number of shared and unshared bytes from the previous key that was read.
IsmFormat.KeyPrefixCoder	A Coder for IsmFormat.KeyPrefix.
IsmFormat.MetadataKeyCoder<K>	A coder for metadata key component.