Package org.apache.beam.sdk.options
package org.apache.beam.sdk.options
Defines
PipelineOptions
for configuring pipeline execution.
PipelineOptions
encapsulates the various parameters that
describe how a pipeline should be run. PipelineOptions
are created using a PipelineOptionsFactory
.
-
ClassDescriptionOptions that allow setting the application name.
Default
represents a set of annotations that can be used to annotate getter properties onPipelineOptions
with information representing the default value to be returned if no value is specified.This represents that the default of the option is the specified boolean primitive value.This represents that the default of the option is the specified byte primitive value.This represents that the default of the option is the specified char primitive value.This represents that the default of the option is the specifiedClass
value.This represents that the default of the option is the specified double primitive value.This represents that the default of the option is the specified enum.This represents that the default of the option is the specified float primitive value.Value must be of typeDefaultValueFactory
and have a default constructor.This represents that the default of the option is the specified int primitive value.This represents that the default of the option is the specified long primitive value.This represents that the default of the option is the specified short primitive value.This represents that the default of the option is the specifiedString
value.APipelineOptionsRegistrar
containing thePipelineOptions
subclasses available by default.An interface used with theDefault.InstanceFactory
annotation to specify the class that will be an instance factory to produce default values for a given getter onPipelineOptions
.Descriptions are used to generate human readable output when the--help
command is specified.Options for configuring theScheduledExecutorService
used throughout the Java runtime.Returns the defaultScheduledExecutorService
to use within the Apache Beam SDK.Apache Beam provides a number of experimental features that can be enabled with this flag.File staging related options.Methods and/or interfaces annotated with@Hidden
will be suppressed from being output when--help
is specified on the command-line.Pipeline options to tune DockerEnvironment.Register theManualDockerEnvironmentOptions
.Options that are used to control the Memory Monitor.PipelineOptions are used to configure Pipelines.DefaultValueFactory
which supplies an ID that is guaranteed to be unique within the given process.Enumeration of the possible states for a given check.ADefaultValueFactory
that obtains the class of theDirectRunner
if it exists on the classpath, and throws an exception otherwise.Returns a normalized job name constructed fromApplicationNameOptions.getAppName()
, the local system user name (if available), the current time, and a random integer.Returns a user agent string constructed fromReleaseInfo.getName()
andReleaseInfo.getVersion()
, in the format[name]/[version]
.Constructs aPipelineOptions
or any derived interface that is composable to any other derived interface ofPipelineOptions
via thePipelineOptions.as(java.lang.Class<T>)
method.A fluentPipelineOptions
builder.PipelineOptions
creators have the ability to automatically have theirPipelineOptions
registered with this SDK by creating aServiceLoader
entry and a concrete implementation of this interface.Validates that thePipelineOptions
conforms to all theValidation
criteria.Pipeline options common to all portable runners.Options that are used to control configuration of the remote environment.Register theRemoteEnvironmentOptions
.Options that are used to control configuration of the SDK harness.The default implementation which detects how much memory to use for a process wide cache.ADefaultValueFactory
which constructs an instance of the class specified bymaxCacheMemoryUsageMbClass
to compute the maximum amount of memory to allocate to the process wide cache within an SDK harness instance.The set of log levels that can be used in the SDK harness.Specifies the maximum amount of memory to use within the current SDK harness instance.Defines a log level override for a specific class, package, or name.Options used to configure streaming.Validation
represents a set of annotations that can be used to annotate getter properties onPipelineOptions
with information representing the validation criteria to be used when validating with thePipelineOptionsValidator
.This criteria specifies that the value must be not null.AValueProvider
abstracts the notion of fetching a value that may or may not be currently available.For internal use only; no backwards compatibility guarantees.ValueProvider.NestedValueProvider
is an implementation ofValueProvider
that allows for wrapping anotherValueProvider
object.ValueProvider.RuntimeValueProvider
is an implementation ofValueProvider
that allows for a value to be provided at execution time rather than at graph construction time.For internal use only; no backwards compatibility guarantees.ValueProvider.StaticValueProvider
is an implementation ofValueProvider
that allows for a static value to be provided.Utilities for working with theValueProvider
interface.