apache_beam.runners.dataflow.native_io.streaming_create module

Create transform for streaming.

class apache_beam.runners.dataflow.native_io.streaming_create.StreamingCreate(values, coder)[source]

Bases: apache_beam.transforms.ptransform.PTransform

A specialized implementation for Create transform in streaming mode.

Note: There is no unbounded source API in python to wrap the Create source, so we map this to composite of Impulse primitive and an SDF.

class DecodeAndEmitDoFn(encoded_values, coder)[source]

Bases: apache_beam.transforms.core.DoFn

A DoFn which stores encoded versions of elements.

It also stores a Coder to decode and emit those elements. TODO: BEAM-2422 - Make this a SplittableDoFn.

process(unused_element)[source]
class Impulse(label=None)[source]

Bases: apache_beam.transforms.ptransform.PTransform

The Dataflow specific override for the impulse primitive.

expand(pbegin)[source]
get_windowing(inputs)[source]
infer_output_type(unused_input_type)[source]
expand(pbegin)[source]