apache_beam.options.value_provider module

A ValueProvider abstracts the notion of fetching a value that may or may not be currently available.

This can be used to parameterize transforms that only read values in at runtime, for example.

class apache_beam.options.value_provider.ValueProvider

Bases: object

Base class that all other ValueProviders must implement.

is_accessible()

Whether the contents of this ValueProvider is available to routines that run at graph construction time.

get()

Return the value wrapped by this ValueProvider.

class apache_beam.options.value_provider.StaticValueProvider(value_type, value)

Bases: apache_beam.options.value_provider.ValueProvider

StaticValueProvider is an implementation of ValueProvider that allows for a static value to be provided.

Parameters:

• value_type – Type of the static value
• value – Static value

is_accessible()

get()

class apache_beam.options.value_provider.RuntimeValueProvider(option_name, value_type, default_value)

Bases: apache_beam.options.value_provider.ValueProvider

RuntimeValueProvider is an implementation of ValueProvider that allows for a value to be provided at execution time rather than at graph construction time.

runtime_options = None

experiments = {}

is_accessible()

classmethod get_value(option_name, value_type, default_value)

get()

classmethod set_runtime_options(pipeline_options)

class apache_beam.options.value_provider.NestedValueProvider(value, translator)

Bases: apache_beam.options.value_provider.ValueProvider

NestedValueProvider is an implementation of ValueProvider that allows for wrapping another ValueProvider object.

Creates a NestedValueProvider that wraps the provided ValueProvider.

Parameters:

• value – ValueProvider object to wrap
• translator – function that is applied to the ValueProvider

Raises:

RuntimeValueProviderError – if any of the provided objects are not accessible.

is_accessible()

get()

apache_beam.options.value_provider.check_accessible(value_provider_list)

A decorator that checks accessibility of a list of ValueProvider objects.

Parameters:value_provider_list – list of ValueProvider objects Raises:RuntimeValueProviderError – if any of the provided objects are not accessible.