Package org.apache.beam.runners.dataflow.util

package org.apache.beam.runners.dataflow.util

Provides miscellaneous internal utilities used by the Google Cloud Dataflow runner.

Related Packages

Package	Description
org.apache.beam.runners.dataflow	Provides a Beam runner that executes pipelines on the Google Cloud Dataflow service.
org.apache.beam.runners.dataflow.internal	Implementation of the DataflowRunner.
org.apache.beam.runners.dataflow.options	Provides PipelineOptions specific to Google Cloud Dataflow.

Class	Description
CloudObject	A representation of an arbitrary Java object to be instantiated by Dataflow workers.
CloudObjects	Utilities for converting an object to a CloudObject.
CloudObjectTranslator<T>	A translator that takes an object and creates a CloudObject which can be converted back to the original object.
CoderCloudObjectTranslatorRegistrar	Coder authors have the ability to automatically have their Coder registered with the Dataflow Runner by creating a ServiceLoader entry and a concrete implementation of this interface.
DataflowTemplateJob	A DataflowPipelineJob that is returned when --templateRunner is set.
DataflowTransport	Helpers for cloud communication.
DefaultCoderCloudObjectTranslatorRegistrar	The CoderCloudObjectTranslatorRegistrar containing the default collection of Coder Cloud Object Translators.
GcsStager	Utility class for staging files to GCS.
MonitoringUtil	A helper class for monitoring jobs submitted to the service.
MonitoringUtil.JobMessagesHandler	An interface that can be used for defining callbacks to receive a list of JobMessages containing monitoring information.
MonitoringUtil.LoggingHandler	A handler that logs monitoring messages.
MonitoringUtil.TimeStampComparator	Comparator for sorting rows in increasing order based on timestamp.
OutputReference	A representation used by Steps to reference the output of other Steps.
PackageUtil	Helper routines for packages.
PackageUtil.StagedFile
PropertyNames	Constant property names used by the SDK in CloudWorkflow specifications.
RandomAccessData	An elastic-sized byte array which allows you to manipulate it as a stream, or access it directly.
RandomAccessData.RandomAccessDataCoder	A Coder which encodes the valid parts of this stream.
RandomAccessData.UnsignedLexicographicalComparator	A Comparator that compares two byte arrays lexicographically.
RowCoderCloudObjectTranslator	Translator for row coders.
SchemaCoderCloudObjectTranslator	Translator for Schema coders.
Stager	Interface for staging files needed for running a Dataflow pipeline.
Structs	A collection of static methods for manipulating datastructure representations transferred via the Dataflow API.
TimeUtil	A helper class for converting between Dataflow API and SDK time representations.