org.apache.beam.runners.fnexecution.control

Class SdkHarnessClient.BundleProcessor

java.lang.Object

org.apache.beam.runners.fnexecution.control.SdkHarnessClient.BundleProcessor

Enclosing class:

SdkHarnessClient

public class SdkHarnessClient.BundleProcessor
extends java.lang.Object

A processor capable of creating bundles for some registered BeamFnApi.ProcessBundleDescriptor.

Method Summary

Modifier and Type	Method and Description
java.util.concurrent.CompletionStage<org.apache.beam.model.fnexecution.v1.BeamFnApi.RegisterResponse>	getRegistrationFuture()
SdkHarnessClient.ActiveBundle	newBundle(java.util.Map<java.lang.String,RemoteOutputReceiver<?>> outputReceivers, BundleProgressHandler progressHandler) Start a new bundle for the given BeamFnApi.ProcessBundleDescriptor identifier.
SdkHarnessClient.ActiveBundle	newBundle(java.util.Map<java.lang.String,RemoteOutputReceiver<?>> outputReceivers, StateRequestHandler stateRequestHandler, BundleProgressHandler progressHandler) Start a new bundle for the given BeamFnApi.ProcessBundleDescriptor identifier.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getRegistrationFuture

public java.util.concurrent.CompletionStage<org.apache.beam.model.fnexecution.v1.BeamFnApi.RegisterResponse> getRegistrationFuture()

newBundle

public SdkHarnessClient.ActiveBundle newBundle(java.util.Map<java.lang.String,RemoteOutputReceiver<?>> outputReceivers,
                                               BundleProgressHandler progressHandler)

Start a new bundle for the given BeamFnApi.ProcessBundleDescriptor identifier.

The input channels for the returned SdkHarnessClient.ActiveBundle are derived from the instructions in the BeamFnApi.ProcessBundleDescriptor.

NOTE: It is important to SdkHarnessClient.close() each bundle after all elements are emitted.

 try (ActiveBundle bundle = SdkHarnessClient.newBundle(...)) {
   FnDataReceiver<InputT> inputReceiver =
       (FnDataReceiver) bundle.getInputReceivers().get(mainPCollectionId);
   // send all main input elements ...
 }
 

newBundle

public SdkHarnessClient.ActiveBundle newBundle(java.util.Map<java.lang.String,RemoteOutputReceiver<?>> outputReceivers,
                                               StateRequestHandler stateRequestHandler,
                                               BundleProgressHandler progressHandler)

Start a new bundle for the given BeamFnApi.ProcessBundleDescriptor identifier.

The input channels for the returned SdkHarnessClient.ActiveBundle are derived from the instructions in the BeamFnApi.ProcessBundleDescriptor.

NOTE: It is important to SdkHarnessClient.close() each bundle after all elements are emitted.

 try (ActiveBundle bundle = SdkHarnessClient.newBundle(...)) {
   FnDataReceiver<InputT> inputReceiver =
       (FnDataReceiver) bundle.getInputReceivers().get(mainPCollectionId);
   // send all elements ...
 }