Class DoFnRunnerFactory<InT,T>
java.lang.Object
org.apache.beam.runners.spark.structuredstreaming.translation.batch.DoFnRunnerFactory<InT,T>
- All Implemented Interfaces:
Serializable
Factory to create a
DoFnRunner. The factory supports fusing multiple runners into a single one.- See Also:
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic interface -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptioncreate(PipelineOptions options, MetricsAccumulator metrics, org.apache.beam.sdk.util.WindowedValueMultiReceiver output, org.apache.beam.runners.core.StepContext stepContext) Creates a runner backed bystepContextso that state and timers are available.static <InT,T> DoFnRunnerFactory <InT, T> simple(org.apache.beam.sdk.runners.AppliedPTransform<PCollection<? extends InT>, ?, ParDo.MultiOutput<InT, T>> appliedPT, PCollection<InT> input, org.apache.beam.runners.core.SideInputReader sideInputReader, boolean filterMainOutput)
-
Constructor Details
-
DoFnRunnerFactory
public DoFnRunnerFactory()
-
-
Method Details
-
create
@Internal public DoFnRunnerFactory.DoFnRunnerWithTeardown<InT,T> create(PipelineOptions options, MetricsAccumulator metrics, org.apache.beam.sdk.util.WindowedValueMultiReceiver output, org.apache.beam.runners.core.StepContext stepContext) Creates a runner backed bystepContextso that state and timers are available.Only supported for a single, unfused
DoFn: a fused runner cannot drive timers. -
simple
@Internal public static <InT,T> DoFnRunnerFactory<InT,T> simple(org.apache.beam.sdk.runners.AppliedPTransform<PCollection<? extends InT>, ?, ParDo.MultiOutput<InT, T>> appliedPT, PCollection<InT> input, org.apache.beam.runners.core.SideInputReader sideInputReader, boolean filterMainOutput)
-