Package org.apache.beam.sdk.io.datadog

Class DatadogEventWriter

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<KV<Integer,DatadogEvent>,DatadogWriteError>

org.apache.beam.sdk.io.datadog.DatadogEventWriter

All Implemented Interfaces:

Serializable, HasDisplayData

public abstract class DatadogEventWriter
extends DoFn<KV<Integer,DatadogEvent>,DatadogWriteError>

A DoFn to write DatadogEvents to Datadog's Logs API.

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

DoFn.AlwaysFetched, DoFn.BoundedPerElement, DoFn.BundleFinalizer, DoFn.Element, DoFn.FieldAccess, DoFn.FinishBundle, DoFn.FinishBundleContext, DoFn.GetInitialRestriction, DoFn.GetInitialWatermarkEstimatorState, DoFn.GetRestrictionCoder, DoFn.GetSize, DoFn.GetWatermarkEstimatorStateCoder, DoFn.Key, DoFn.MultiOutputReceiver, DoFn.NewTracker, DoFn.NewWatermarkEstimator, DoFn.OnTimer, DoFn.OnTimerContext, DoFn.OnTimerFamily, DoFn.OnWindowExpiration, DoFn.OnWindowExpirationContext, DoFn.OutputReceiver<T>, DoFn.ProcessContext, DoFn.ProcessContinuation, DoFn.ProcessElement, DoFn.RequiresStableInput, DoFn.RequiresTimeSortedInput, DoFn.Restriction, DoFn.Setup, DoFn.SideInput, DoFn.SplitRestriction, DoFn.StartBundle, DoFn.StartBundleContext, DoFn.StateId, DoFn.Teardown, DoFn.TimerFamily, DoFn.TimerId, DoFn.Timestamp, DoFn.TruncateRestriction, DoFn.UnboundedPerElement, DoFn.WatermarkEstimatorState, DoFn.WindowedContext

Field Summary

Fields

Modifier and Type	Field	Description
protected static final String	INVALID_URL_FORMAT_MESSAGE

Method Summary

Modifier and Type	Method	Description
static org.apache.beam.sdk.io.datadog.DatadogEventWriter.Builder	newBuilder()
static org.apache.beam.sdk.io.datadog.DatadogEventWriter.Builder	newBuilder(Integer minBatchCount)
void	onExpiry(DoFn.OutputReceiver<DatadogWriteError> receiver, BagState<DatadogEvent> bufferState, ValueState<Long> countState, ValueState<Long> bufferSizeState)
void	processElement(KV<Integer,DatadogEvent> input, DoFn.OutputReceiver<DatadogWriteError> receiver, BoundedWindow window, BagState<DatadogEvent> bufferState, ValueState<Long> countState, ValueState<Long> bufferSizeState, Timer timer)
void	setup()
void	tearDown()

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, prepareForProcessing

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

INVALID_URL_FORMAT_MESSAGE

protected static final String INVALID_URL_FORMAT_MESSAGE

See Also:

• Constant Field Values

Method Details

newBuilder

public static org.apache.beam.sdk.io.datadog.DatadogEventWriter.Builder newBuilder()

newBuilder

public static org.apache.beam.sdk.io.datadog.DatadogEventWriter.Builder newBuilder(@Nullable
 Integer minBatchCount)

setup

@Setup
public void setup()

processElement

@ProcessElement
public void processElement(@Element
 KV<Integer,DatadogEvent> input,
 DoFn.OutputReceiver<DatadogWriteError> receiver,
 BoundedWindow window,
 @StateId("buffer")
 BagState<DatadogEvent> bufferState,
 @StateId("count")
 ValueState<Long> countState,
 @StateId("buffer_size")
 ValueState<Long> bufferSizeState,
 @TimerId("expiry")
 Timer timer)
                    throws IOException

Throws:

IOException

onExpiry

@OnTimer("expiry")
public void onExpiry(DoFn.OutputReceiver<DatadogWriteError> receiver,
 @StateId("buffer")
 BagState<DatadogEvent> bufferState,
 @StateId("count")
 ValueState<Long> countState,
 @StateId("buffer_size")
 ValueState<Long> bufferSizeState)
              throws IOException

Throws:

IOException

tearDown

@Teardown
public void tearDown()