org.apache.beam.sdk.io.gcp.bigquery

Class StorageApiFlushAndFinalizeDoFn

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<KV<java.lang.String,org.apache.beam.sdk.io.gcp.bigquery.StorageApiFlushAndFinalizeDoFn.Operation>,java.lang.Void>

org.apache.beam.sdk.io.gcp.bigquery.StorageApiFlushAndFinalizeDoFn

All Implemented Interfaces:

java.io.Serializable, HasDisplayData

public class StorageApiFlushAndFinalizeDoFn
extends DoFn<KV<java.lang.String,org.apache.beam.sdk.io.gcp.bigquery.StorageApiFlushAndFinalizeDoFn.Operation>,java.lang.Void>

This DoFn flushes and optionally (if requested) finalizes Storage API streams.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

DoFn.AlwaysFetched, DoFn.BoundedPerElement, DoFn.BundleFinalizer, DoFn.Element, DoFn.FieldAccess, DoFn.FinishBundle, DoFn.FinishBundleContext, DoFn.GetInitialRestriction, DoFn.GetInitialWatermarkEstimatorState, DoFn.GetRestrictionCoder, DoFn.GetSize, DoFn.GetWatermarkEstimatorStateCoder, DoFn.Key, DoFn.MultiOutputReceiver, DoFn.NewTracker, DoFn.NewWatermarkEstimator, DoFn.OnTimer, DoFn.OnTimerContext, DoFn.OnTimerFamily, DoFn.OnWindowExpiration, DoFn.OnWindowExpirationContext, DoFn.OutputReceiver<T>, DoFn.ProcessContext, DoFn.ProcessContinuation, DoFn.ProcessElement, DoFn.RequiresStableInput, DoFn.RequiresTimeSortedInput, DoFn.Restriction, DoFn.Setup, DoFn.SideInput, DoFn.SplitRestriction, DoFn.StartBundle, DoFn.StartBundleContext, DoFn.StateId, DoFn.Teardown, DoFn.TimerFamily, DoFn.TimerId, DoFn.Timestamp, DoFn.TruncateRestriction, DoFn.UnboundedPerElement, DoFn.WatermarkEstimatorState, DoFn.WindowedContext

Constructor Summary

Constructors

Constructor and Description
StorageApiFlushAndFinalizeDoFn(BigQueryServices bqServices)

Method Summary

Modifier and Type	Method and Description
void	onTeardown()
void	process(PipelineOptions pipelineOptions, KV<java.lang.String,org.apache.beam.sdk.io.gcp.bigquery.StorageApiFlushAndFinalizeDoFn.Operation> element)

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, prepareForProcessing

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StorageApiFlushAndFinalizeDoFn

public StorageApiFlushAndFinalizeDoFn(BigQueryServices bqServices)

Method Detail

onTeardown

@DoFn.Teardown
public void onTeardown()

process

@DoFn.ProcessElement
public void process(PipelineOptions pipelineOptions,
                                         @DoFn.Element
                                         KV<java.lang.String,org.apache.beam.sdk.io.gcp.bigquery.StorageApiFlushAndFinalizeDoFn.Operation> element)
                                  throws java.lang.Exception

Throws:

java.lang.Exception