Package org.apache.beam.sdk.io.gcp.bigquery

Class StorageApiFlushAndFinalizeDoFn

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<KV<String,org.apache.beam.sdk.io.gcp.bigquery.StorageApiFlushAndFinalizeDoFn.Operation>,Void>

org.apache.beam.sdk.io.gcp.bigquery.StorageApiFlushAndFinalizeDoFn

All Implemented Interfaces:

Serializable, HasDisplayData

public class StorageApiFlushAndFinalizeDoFn
extends DoFn<KV<String,org.apache.beam.sdk.io.gcp.bigquery.StorageApiFlushAndFinalizeDoFn.Operation>,Void>

This DoFn flushes and optionally (if requested) finalizes Storage API streams.

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

DoFn.AlwaysFetched, DoFn.BoundedPerElement, DoFn.BundleFinalizer, DoFn.Element, DoFn.FieldAccess, DoFn.FinishBundle, DoFn.FinishBundleContext, DoFn.GetInitialRestriction, DoFn.GetInitialWatermarkEstimatorState, DoFn.GetRestrictionCoder, DoFn.GetSize, DoFn.GetWatermarkEstimatorStateCoder, DoFn.Key, DoFn.MultiOutputReceiver, DoFn.NewTracker, DoFn.NewWatermarkEstimator, DoFn.OnTimer, DoFn.OnTimerContext, DoFn.OnTimerFamily, DoFn.OnWindowExpiration, DoFn.OnWindowExpirationContext, DoFn.OutputReceiver<T>, DoFn.ProcessContext, DoFn.ProcessContinuation, DoFn.ProcessElement, DoFn.RequiresStableInput, DoFn.RequiresTimeSortedInput, DoFn.Restriction, DoFn.Setup, DoFn.SideInput, DoFn.SplitRestriction, DoFn.StartBundle, DoFn.StartBundleContext, DoFn.StateId, DoFn.Teardown, DoFn.TimerFamily, DoFn.TimerId, DoFn.Timestamp, DoFn.TruncateRestriction, DoFn.UnboundedPerElement, DoFn.WatermarkEstimatorState, DoFn.WindowedContext

Constructor Summary

Constructors

Constructor	Description
StorageApiFlushAndFinalizeDoFn(BigQueryServices bqServices)

Method Summary

Modifier and Type	Method	Description
void	onTeardown()
void	process(PipelineOptions pipelineOptions, KV<String,org.apache.beam.sdk.io.gcp.bigquery.StorageApiFlushAndFinalizeDoFn.Operation> element)

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, prepareForProcessing

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

StorageApiFlushAndFinalizeDoFn

public StorageApiFlushAndFinalizeDoFn(BigQueryServices bqServices)

Method Details

onTeardown

@Teardown
public void onTeardown()

process

@ProcessElement
public void process(PipelineOptions pipelineOptions,
 @Element
 KV<String,org.apache.beam.sdk.io.gcp.bigquery.StorageApiFlushAndFinalizeDoFn.Operation> element)
             throws Exception

Throws:

Exception