org.apache.beam.sdk.io.solace.write

Class AddShardKeyDoFn

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<Solace.Record,KV<java.lang.Integer,Solace.Record>>

org.apache.beam.sdk.io.solace.write.AddShardKeyDoFn

All Implemented Interfaces:

java.io.Serializable, HasDisplayData

@Internal
public class AddShardKeyDoFn
extends DoFn<Solace.Record,KV<java.lang.Integer,Solace.Record>>

This class a pseudo-key with a given cardinality. The downstream steps will use state & timers to distribute the data and control for the number of parallel workers used for writing.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

DoFn.AlwaysFetched, DoFn.BoundedPerElement, DoFn.BundleFinalizer, DoFn.Element, DoFn.FieldAccess, DoFn.FinishBundle, DoFn.FinishBundleContext, DoFn.GetInitialRestriction, DoFn.GetInitialWatermarkEstimatorState, DoFn.GetRestrictionCoder, DoFn.GetSize, DoFn.GetWatermarkEstimatorStateCoder, DoFn.Key, DoFn.MultiOutputReceiver, DoFn.NewTracker, DoFn.NewWatermarkEstimator, DoFn.OnTimer, DoFn.OnTimerContext, DoFn.OnTimerFamily, DoFn.OnWindowExpiration, DoFn.OnWindowExpirationContext, DoFn.OutputReceiver<T>, DoFn.ProcessContext, DoFn.ProcessContinuation, DoFn.ProcessElement, DoFn.RequiresStableInput, DoFn.RequiresTimeSortedInput, DoFn.Restriction, DoFn.Setup, DoFn.SideInput, DoFn.SplitRestriction, DoFn.StartBundle, DoFn.StartBundleContext, DoFn.StateId, DoFn.Teardown, DoFn.TimerFamily, DoFn.TimerId, DoFn.Timestamp, DoFn.TruncateRestriction, DoFn.UnboundedPerElement, DoFn.WatermarkEstimatorState, DoFn.WindowedContext

Constructor Summary

Constructors

Constructor and Description
AddShardKeyDoFn(int shardCount)

Method Summary

Modifier and Type	Method and Description
void	processElement(Solace.Record record, DoFn.OutputReceiver<KV<java.lang.Integer,Solace.Record>> c)

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, prepareForProcessing

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AddShardKeyDoFn

public AddShardKeyDoFn(int shardCount)

Method Detail

processElement

@DoFn.ProcessElement
public void processElement(@DoFn.Element
                                                Solace.Record record,
                                                DoFn.OutputReceiver<KV<java.lang.Integer,Solace.Record>> c)