Package org.apache.beam.runners.dataflow.options

package org.apache.beam.runners.dataflow.options

Provides PipelineOptions specific to Google Cloud Dataflow.

Related Packages

Package	Description
org.apache.beam.runners.dataflow	Provides a Beam runner that executes pipelines on the Google Cloud Dataflow service.
org.apache.beam.runners.dataflow.internal	Implementation of the DataflowRunner.
org.apache.beam.runners.dataflow.util	Provides miscellaneous internal utilities used by the Google Cloud Dataflow runner.

Class	Description
DataflowPipelineDebugOptions	Internal.
DataflowPipelineDebugOptions.DataflowClientFactory	Returns the default Dataflow client built from the passed in PipelineOptions.
DataflowPipelineDebugOptions.StagerFactory	Creates a Stager object using the class specified in DataflowPipelineDebugOptions.getStagerClass().
DataflowPipelineDebugOptions.UnboundedReaderMaxReadTimeFactory	Sets Integer value based on old, deprecated field (DataflowPipelineDebugOptions.getUnboundedReaderMaxReadTimeSec()).
DataflowPipelineOptions	Options that can be used to configure the DataflowRunner.
DataflowPipelineOptions.FlexResourceSchedulingGoal	Set of available Flexible Resource Scheduling goals.
DataflowPipelineOptions.StagingLocationFactory	Returns a default staging location under GcpOptions.getGcpTempLocation().
DataflowPipelineWorkerPoolOptions	Options that are used to configure the Dataflow pipeline worker pool.
DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType	Type of autoscaling algorithm to use.
DataflowProfilingOptions	Options for controlling profiling of pipeline execution.
DataflowProfilingOptions.DataflowProfilingAgentConfiguration	Configuration the for profiling agent.
DataflowStreamingPipelineOptions	[Internal] Options for configuring StreamingDataflowWorker.
DataflowStreamingPipelineOptions.EnableWindmillServiceDirectPathFactory	EnableStreamingEngine defaults to false unless one of the experiment is set.
DataflowStreamingPipelineOptions.GlobalConfigRefreshPeriodFactory	Read global get config request period from system property 'windmill.global_config_refresh_period'.
DataflowStreamingPipelineOptions.HarnessUpdateReportingPeriodFactory	Read counter reporting period from system property 'windmill.harness_update_reporting_period'.
DataflowStreamingPipelineOptions.LocalWindmillHostportFactory	Factory for creating local Windmill address.
DataflowStreamingPipelineOptions.MaxStackTraceDepthToReportFactory	Read 'MaxStackTraceToReport' from system property 'windmill.max_stack_trace_to_report' or Integer.MAX_VALUE if unspecified.
DataflowStreamingPipelineOptions.PeriodicStatusPageDirectoryFactory	Read 'PeriodicStatusPageOutputDirector' from system property 'windmill.periodic_status_page_directory' or null if unspecified.
DataflowStreamingPipelineOptions.WindmillServiceStreamingRpcBatchLimitFactory	Factory for setting value of WindmillServiceStreamingRpcBatchLimit based on environment.
DataflowWorkerHarnessOptions	Options that are used exclusively within the Dataflow worker harness.
DataflowWorkerLoggingOptions	Deprecated. This interface will no longer be the source of truth for worker logging configuration once jobs are executed using a dedicated SDK harness instead of user code being co-located alongside Dataflow worker code.
DataflowWorkerLoggingOptions.Level	The set of log levels that can be used on the Dataflow worker.
DataflowWorkerLoggingOptions.WorkerLogLevelOverrides	Defines a log level override for a specific class, package, or name.
DefaultGcpRegionFactory	Factory for a default value for Google Cloud region according to https://cloud.google.com/compute/docs/gcloud-compute/#default-properties.