apache_beam.yaml.yaml_mapping module

This module defines the basic MapToFields operation.

apache_beam.yaml.yaml_mapping.normalize_mapping(spec)[source]

Normalizes various fields for mapping transforms.

apache_beam.yaml.yaml_mapping.is_literal(expr: str) bool[source]
apache_beam.yaml.yaml_mapping.validate_generic_expression(expr_dict: dict, input_fields: Collection[str], allow_cmp: bool, error_field: str) None[source]
apache_beam.yaml.yaml_mapping.validate_generic_expressions(base_type, config, input_pcolls) None[source]
apache_beam.yaml.yaml_mapping.py_value_to_js_dict(py_value)[source]
class apache_beam.yaml.yaml_mapping.ErrorHandlingConfig(output: str)[source]

Bases: NamedTuple

Class to define Error Handling parameters.

Parameters:

output (str) – Name to use for the output error collection

Create new instance of ErrorHandlingConfig(output,)

output: str

Alias for field number 0

apache_beam.yaml.yaml_mapping.exception_handling_args(error_handling_spec)[source]
apache_beam.yaml.yaml_mapping.maybe_with_exception_handling(inner_expand)[source]
apache_beam.yaml.yaml_mapping.maybe_with_exception_handling_transform_fn(transform_fn)[source]
apache_beam.yaml.yaml_mapping.is_expr(v)[source]
apache_beam.yaml.yaml_mapping.normalize_fields(pcoll, fields, drop=(), append=False, language='generic')[source]
apache_beam.yaml.yaml_mapping.create_mapping_providers()[source]