Package org.apache.beam.runners.dataflow

Class BatchStatefulParDoOverrides.BatchStatefulDoFn<K,V,OutputT>

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<KV<K,Iterable<KV<Instant,WindowedValue<KV<K,V>>>>>,OutputT>

org.apache.beam.runners.dataflow.BatchStatefulParDoOverrides.BatchStatefulDoFn<K,V,OutputT>

All Implemented Interfaces:

Serializable, HasDisplayData

Enclosing class:

BatchStatefulParDoOverrides

public static class BatchStatefulParDoOverrides.BatchStatefulDoFn<K,V,OutputT>
extends DoFn<KV<K,Iterable<KV<Instant,WindowedValue<KV<K,V>>>>>,OutputT>

A key-preserving DoFn that explodes an iterable that has been grouped by key and window.

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

DoFn.AlwaysFetched, DoFn.BoundedPerElement, DoFn.BundleFinalizer, DoFn.Element, DoFn.FieldAccess, DoFn.FinishBundle, DoFn.FinishBundleContext, DoFn.GetInitialRestriction, DoFn.GetInitialWatermarkEstimatorState, DoFn.GetRestrictionCoder, DoFn.GetSize, DoFn.GetWatermarkEstimatorStateCoder, DoFn.Key, DoFn.MultiOutputReceiver, DoFn.NewTracker, DoFn.NewWatermarkEstimator, DoFn.OnTimer, DoFn.OnTimerContext, DoFn.OnTimerFamily, DoFn.OnWindowExpiration, DoFn.OnWindowExpirationContext, DoFn.OutputReceiver<T>, DoFn.ProcessContext, DoFn.ProcessContinuation, DoFn.ProcessElement, DoFn.RequiresStableInput, DoFn.RequiresTimeSortedInput, DoFn.Restriction, DoFn.Setup, DoFn.SideInput, DoFn.SplitRestriction, DoFn.StartBundle, DoFn.StartBundleContext, DoFn.StateId, DoFn.Teardown, DoFn.TimerFamily, DoFn.TimerId, DoFn.Timestamp, DoFn.TruncateRestriction, DoFn.UnboundedPerElement, DoFn.WatermarkEstimatorState, DoFn.WindowedContext

Method Summary

Modifier and Type	Method	Description
TypeDescriptor<OutputT>	getOutputTypeDescriptor()	Returns a TypeDescriptor capturing what is known statically about the output type of this DoFn instance's most-derived class.
DoFn<KV<K,V>,OutputT>	getUnderlyingDoFn()
void	processElement(DoFn<KV<K,Iterable<KV<Instant,WindowedValue<KV<K,V>>>>>,OutputT>.ProcessContext c, BoundedWindow window)
void	setup(PipelineOptions options)
void	teardown()

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

getAllowedTimestampSkew, getInputTypeDescriptor, populateDisplayData, prepareForProcessing

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

getUnderlyingDoFn

public DoFn<KV<K,V>,OutputT> getUnderlyingDoFn()

setup

@Setup
public void setup(PipelineOptions options)

processElement

@ProcessElement
public void processElement(DoFn<KV<K,Iterable<KV<Instant,WindowedValue<KV<K,V>>>>>,OutputT>.ProcessContext c,
 BoundedWindow window)

teardown

@Teardown
public void teardown()

getOutputTypeDescriptor

public TypeDescriptor<OutputT> getOutputTypeDescriptor()

Description copied from class: DoFn

Returns a TypeDescriptor capturing what is known statically about the output type of this DoFn instance's most-derived class.

In the normal case of a concrete DoFn subclass with no generic type parameters of its own (including anonymous inner classes), this will be a complete non-generic type, which is good for choosing a default output Coder<O> for the output PCollection<O>.

Overrides:

getOutputTypeDescriptor in class DoFn<KV<K,Iterable<KV<Instant,WindowedValue<KV<K,V>>>>>,OutputT>