org.apache.beam.sdk.io.gcp.pubsub

Class PubsubIO.Write.PubsubBoundedWriter

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<PubsubMessage,java.lang.Void>

org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.Write.PubsubBoundedWriter

All Implemented Interfaces:

java.io.Serializable, HasDisplayData

Enclosing class:

PubsubIO.Write<T>

public class PubsubIO.Write.PubsubBoundedWriter
extends DoFn<PubsubMessage,java.lang.Void>

Writer to Pubsub which batches messages from bounded collections.

Public so can be suppressed by runners.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

DoFn.AlwaysFetched, DoFn.BoundedPerElement, DoFn.BundleFinalizer, DoFn.Element, DoFn.FieldAccess, DoFn.FinishBundle, DoFn.FinishBundleContext, DoFn.GetInitialRestriction, DoFn.GetInitialWatermarkEstimatorState, DoFn.GetRestrictionCoder, DoFn.GetSize, DoFn.GetWatermarkEstimatorStateCoder, DoFn.Key, DoFn.MultiOutputReceiver, DoFn.NewTracker, DoFn.NewWatermarkEstimator, DoFn.OnTimer, DoFn.OnTimerContext, DoFn.OnTimerFamily, DoFn.OnWindowExpiration, DoFn.OnWindowExpirationContext, DoFn.OutputReceiver<T>, DoFn.ProcessContext, DoFn.ProcessContinuation, DoFn.ProcessElement, DoFn.RequiresStableInput, DoFn.RequiresTimeSortedInput, DoFn.Restriction, DoFn.Setup, DoFn.SideInput, DoFn.SplitRestriction, DoFn.StartBundle, DoFn.StartBundleContext, DoFn.StateId, DoFn.Teardown, DoFn.TimerFamily, DoFn.TimerId, DoFn.Timestamp, DoFn.TruncateRestriction, DoFn.UnboundedPerElement, DoFn.WatermarkEstimatorState, DoFn.WindowedContext

Method Summary

Modifier and Type	Method and Description
void	finishBundle()
void	populateDisplayData(DisplayData.Builder builder) Register display data for the given transform or component.
void	processElement(PubsubMessage message, Instant timestamp)
void	startBundle(DoFn.StartBundleContext c)

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, prepareForProcessing

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

startBundle

@DoFn.StartBundle
public void startBundle(DoFn.StartBundleContext c)
                                   throws java.io.IOException

Throws:

java.io.IOException

processElement

@DoFn.ProcessElement
public void processElement(@DoFn.Element
                                                PubsubMessage message,
                                                @DoFn.Timestamp
                                                Instant timestamp)
                                         throws java.io.IOException,
                                                javax.naming.SizeLimitExceededException

Throws:

java.io.IOException

javax.naming.SizeLimitExceededException

finishBundle

@DoFn.FinishBundle
public void finishBundle()
                                     throws java.io.IOException

Throws:

java.io.IOException

populateDisplayData

public void populateDisplayData(DisplayData.Builder builder)

Description copied from class: DoFn

Register display data for the given transform or component.

populateDisplayData(DisplayData.Builder) is invoked by Pipeline runners to collect display data via DisplayData.from(HasDisplayData). Implementations may call super.populateDisplayData(builder) in order to register display data in the current namespace, but should otherwise use subcomponent.populateDisplayData(builder) to use the namespace of the subcomponent.

By default, does not register any display data. Implementors may override this method to provide their own display data.

Specified by:

populateDisplayData in interface HasDisplayData

Overrides:

populateDisplayData in class DoFn<PubsubMessage,java.lang.Void>

Parameters:

builder - The builder to populate with display data.

See Also:

HasDisplayData