Package org.apache.beam.sdk.io.solace.write

Class UnboundedSolaceWriter

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<KV<Integer,Solace.Record>,Solace.PublishResult>

org.apache.beam.sdk.io.solace.write.UnboundedSolaceWriter

All Implemented Interfaces:

Serializable, HasDisplayData

Direct Known Subclasses:

UnboundedBatchedSolaceWriter, UnboundedStreamingSolaceWriter

@Internal
public abstract class UnboundedSolaceWriter
extends DoFn<KV<Integer,Solace.Record>,Solace.PublishResult>

This DoFn encapsulates common code used both for the UnboundedBatchedSolaceWriter and UnboundedStreamingSolaceWriter.

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

DoFn.AlwaysFetched, DoFn.BoundedPerElement, DoFn.BundleFinalizer, DoFn.Element, DoFn.FieldAccess, DoFn.FinishBundle, DoFn.FinishBundleContext, DoFn.GetInitialRestriction, DoFn.GetInitialWatermarkEstimatorState, DoFn.GetRestrictionCoder, DoFn.GetSize, DoFn.GetWatermarkEstimatorStateCoder, DoFn.Key, DoFn.MultiOutputReceiver, DoFn.NewTracker, DoFn.NewWatermarkEstimator, DoFn.OnTimer, DoFn.OnTimerContext, DoFn.OnTimerFamily, DoFn.OnWindowExpiration, DoFn.OnWindowExpirationContext, DoFn.OutputReceiver<T>, DoFn.ProcessContext, DoFn.ProcessContinuation, DoFn.ProcessElement, DoFn.RequiresStableInput, DoFn.RequiresTimeSortedInput, DoFn.Restriction, DoFn.Setup, DoFn.SideInput, DoFn.SplitRestriction, DoFn.StartBundle, DoFn.StartBundleContext, DoFn.StateId, DoFn.Teardown, DoFn.TimerFamily, DoFn.TimerId, DoFn.Timestamp, DoFn.TruncateRestriction, DoFn.UnboundedPerElement, DoFn.WatermarkEstimatorState, DoFn.WindowedContext

Constructor Summary

Constructors

Constructor	Description
UnboundedSolaceWriter(SerializableFunction<Solace.Record,Destination> destinationFn, SessionServiceFactory sessionServiceFactory, DeliveryMode deliveryMode, SolaceIO.SubmissionMode submissionMode, int producersMapCardinality, boolean publishLatencyMetrics)

Method Summary

Modifier and Type	Method	Description
void	addToCurrentBundle(Solace.Record record)
JCSMPSendMultipleEntry[]	createMessagesArray(Iterable<Solace.Record> records, boolean useCorrelationKeyLatency)
BytesXMLMessage	createSingleMessage(Solace.Record record, boolean useCorrelationKeyLatency)
List<Solace.Record>	getCurrentBundle()
@Nullable Instant	getCurrentBundleTimestamp()
DeliveryMode	getDeliveryMode()
SerializableFunction<Solace.Record,Destination>	getDestinationFn()
Distribution	getFailedLatencyMetric()
int	getProducersMapCardinality()
Distribution	getPublishLatencyMetric()
SolaceIO.SubmissionMode	getSubmissionMode()
void	publishResults(org.apache.beam.sdk.io.solace.write.UnboundedSolaceWriter.BeamContextWrapper context)
void	setCurrentBundleTimestamp(Instant bundleTimestamp)
boolean	shouldPublishLatencyMetrics()
SessionService	solaceSessionServiceWithProducer()
void	startBundle()
void	teardown()
void	updateProducerIndex()

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, prepareForProcessing

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

UnboundedSolaceWriter

public UnboundedSolaceWriter(SerializableFunction<Solace.Record,Destination> destinationFn,
 SessionServiceFactory sessionServiceFactory,
 DeliveryMode deliveryMode,
 SolaceIO.SubmissionMode submissionMode,
 int producersMapCardinality,
 boolean publishLatencyMetrics)

Method Details

teardown

@Teardown
public void teardown()

updateProducerIndex

public void updateProducerIndex()

startBundle

@StartBundle
public void startBundle()

solaceSessionServiceWithProducer

public SessionService solaceSessionServiceWithProducer()

publishResults

public void publishResults(org.apache.beam.sdk.io.solace.write.UnboundedSolaceWriter.BeamContextWrapper context)

createSingleMessage

public BytesXMLMessage createSingleMessage(Solace.Record record,
 boolean useCorrelationKeyLatency)

createMessagesArray

public JCSMPSendMultipleEntry[] createMessagesArray(Iterable<Solace.Record> records,
 boolean useCorrelationKeyLatency)

getProducersMapCardinality

public int getProducersMapCardinality()

getPublishLatencyMetric

public Distribution getPublishLatencyMetric()

getFailedLatencyMetric

public Distribution getFailedLatencyMetric()

shouldPublishLatencyMetrics

public boolean shouldPublishLatencyMetrics()

getDestinationFn

public SerializableFunction<Solace.Record,Destination> getDestinationFn()

getDeliveryMode

public DeliveryMode getDeliveryMode()

getSubmissionMode

public SolaceIO.SubmissionMode getSubmissionMode()

addToCurrentBundle

public void addToCurrentBundle(Solace.Record record)

getCurrentBundle

public List<Solace.Record> getCurrentBundle()

getCurrentBundleTimestamp

public @Nullable Instant getCurrentBundleTimestamp()

setCurrentBundleTimestamp

public void setCurrentBundleTimestamp(Instant bundleTimestamp)