apache_beam.runners.dataflow.native_io.streaming_create module

Create transform for streaming.

class apache_beam.runners.dataflow.native_io.streaming_create.StreamingCreate(values, coder)

Bases: apache_beam.transforms.ptransform.PTransform

A specialized implementation for Create transform in streaming mode.

Note: There is no unbounded source API in python to wrap the Create source, so we map this to composite of Impulse primitive and an SDF.

class DecodeAndEmitDoFn(encoded_values, coder)

Bases: apache_beam.transforms.core.DoFn

A DoFn which stores encoded versions of elements.

It also stores a Coder to decode and emit those elements. TODO: BEAM-2422 - Make this a SplittableDoFn.

process(unused_element)

class Impulse(label=None)

Bases: apache_beam.transforms.ptransform.PTransform

The Dataflow specific override for the impulse primitive.

expand(pbegin)

get_windowing(inputs)

infer_output_type(unused_input_type)

expand(pbegin)