Package org.apache.beam.sdk.io.solace.write

Class AddShardKeyDoFn

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<Solace.Record,KV<Integer,Solace.Record>>

org.apache.beam.sdk.io.solace.write.AddShardKeyDoFn

All Implemented Interfaces:

Serializable, HasDisplayData

@Internal
public class AddShardKeyDoFn
extends DoFn<Solace.Record,KV<Integer,Solace.Record>>

This class adds pseudo-key with a given cardinality. The downstream steps will use state & timers to distribute the data and control for the number of parallel workers used for writing.

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

DoFn.AlwaysFetched, DoFn.BoundedPerElement, DoFn.BundleFinalizer, DoFn.Element, DoFn.FieldAccess, DoFn.FinishBundle, DoFn.FinishBundleContext, DoFn.GetInitialRestriction, DoFn.GetInitialWatermarkEstimatorState, DoFn.GetRestrictionCoder, DoFn.GetSize, DoFn.GetWatermarkEstimatorStateCoder, DoFn.Key, DoFn.MultiOutputReceiver, DoFn.NewTracker, DoFn.NewWatermarkEstimator, DoFn.OnTimer, DoFn.OnTimerContext, DoFn.OnTimerFamily, DoFn.OnWindowExpiration, DoFn.OnWindowExpirationContext, DoFn.OutputReceiver<T>, DoFn.ProcessContext, DoFn.ProcessContinuation, DoFn.ProcessElement, DoFn.RequiresStableInput, DoFn.RequiresTimeSortedInput, DoFn.Restriction, DoFn.Setup, DoFn.SideInput, DoFn.SplitRestriction, DoFn.StartBundle, DoFn.StartBundleContext, DoFn.StateId, DoFn.Teardown, DoFn.TimerFamily, DoFn.TimerId, DoFn.Timestamp, DoFn.TruncateRestriction, DoFn.UnboundedPerElement, DoFn.WatermarkEstimatorState, DoFn.WindowedContext

Constructor Summary

Constructors

Constructor	Description
AddShardKeyDoFn(int shardCount)

Method Summary

Modifier and Type	Method	Description
void	processElement(Solace.Record record, DoFn.OutputReceiver<KV<Integer,Solace.Record>> c)

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, prepareForProcessing

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

AddShardKeyDoFn

public AddShardKeyDoFn(int shardCount)

Method Details

processElement

@ProcessElement
public void processElement(@Element
 Solace.Record record,
 DoFn.OutputReceiver<KV<Integer,Solace.Record>> c)