Package org.apache.beam.runners.dataflow.options

Provides PipelineOptions specific to Google Cloud Dataflow.

See: Description

Interface Summary

Interface	Description
CloudDebuggerOptions	Options for controlling Cloud Debugger.
DataflowPipelineDebugOptions	Internal.
DataflowPipelineOptions	Options that can be used to configure the DataflowRunner.
DataflowPipelineWorkerPoolOptions	Options that are used to configure the Dataflow pipeline worker pool.
DataflowProfilingOptions	Options for controlling profiling of pipeline execution.
DataflowWorkerHarnessOptions	Options that are used exclusively within the Dataflow worker harness.
DataflowWorkerLoggingOptions	Deprecated This interface will no longer be the source of truth for worker logging configuration once jobs are executed using a dedicated SDK harness instead of user code being co-located alongside Dataflow worker code.

Class Summary

Class	Description
DataflowPipelineDebugOptions.DataflowClientFactory	Returns the default Dataflow client built from the passed in PipelineOptions.
DataflowPipelineDebugOptions.StagerFactory	Creates a Stager object using the class specified in DataflowPipelineDebugOptions.getStagerClass().
DataflowPipelineOptions.DefaultGcpRegionFactory	Factory for a default value for Google Cloud region according to https://cloud.google.com/compute/docs/gcloud-compute/#default-properties.
DataflowPipelineOptions.StagingLocationFactory	Returns a default staging location under GcpOptions.getGcpTempLocation().
DataflowPipelineWorkerPoolOptions.WorkerHarnessContainerImageFactory	Returns the default Docker container image that executes Dataflow worker harness, residing in Google Container Registry.
DataflowProfilingOptions.DataflowProfilingAgentConfiguration	Configuration the for profiling agent.
DataflowWorkerLoggingOptions.WorkerLogLevelOverrides	Defines a log level override for a specific class, package, or name.

Enum Summary

Enum	Description
DataflowPipelineOptions.FlexResourceSchedulingGoal	Set of available Flexible Resource Scheduling goals.
DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType	Type of autoscaling algorithm to use.
DataflowWorkerLoggingOptions.Level	The set of log levels that can be used on the Dataflow worker.

Package org.apache.beam.runners.dataflow.options Description

Provides PipelineOptions specific to Google Cloud Dataflow.