public class StorageApiWritesShardedRecords<DestinationT,ElementT> extends PTransform<PCollection<KV<org.apache.beam.sdk.util.ShardedKey<DestinationT>,java.lang.Iterable<StorageApiWritePayload>>>,PCollectionTuple>
annotations, displayData, name, resourceHints
Constructor and Description |
---|
StorageApiWritesShardedRecords(org.apache.beam.sdk.io.gcp.bigquery.StorageApiDynamicDestinations<ElementT,DestinationT> dynamicDestinations,
BigQueryIO.Write.CreateDisposition createDisposition,
java.lang.String kmsKey,
BigQueryServices bqServices,
Coder<DestinationT> destinationCoder,
Coder<BigQueryStorageApiInsertError> failedRowsCoder,
Coder<TableRow> successfulRowsCoder,
TupleTag<BigQueryStorageApiInsertError> failedRowsTag,
@Nullable TupleTag<TableRow> successfulRowsTag,
boolean autoUpdateSchema,
boolean ignoreUnknownValues,
com.google.cloud.bigquery.storage.v1.AppendRowsRequest.MissingValueInterpretation defaultMissingValueInterpretation) |
Modifier and Type | Method and Description |
---|---|
PCollectionTuple |
expand(PCollection<KV<org.apache.beam.sdk.util.ShardedKey<DestinationT>,java.lang.Iterable<StorageApiWritePayload>>> input)
Override this method to specify how this
PTransform should be expanded on the given
InputT . |
addAnnotation, compose, compose, getAdditionalInputs, getAnnotations, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setDisplayData, setResourceHints, toString, validate, validate
public StorageApiWritesShardedRecords(org.apache.beam.sdk.io.gcp.bigquery.StorageApiDynamicDestinations<ElementT,DestinationT> dynamicDestinations, BigQueryIO.Write.CreateDisposition createDisposition, java.lang.String kmsKey, BigQueryServices bqServices, Coder<DestinationT> destinationCoder, Coder<BigQueryStorageApiInsertError> failedRowsCoder, Coder<TableRow> successfulRowsCoder, TupleTag<BigQueryStorageApiInsertError> failedRowsTag, @Nullable TupleTag<TableRow> successfulRowsTag, boolean autoUpdateSchema, boolean ignoreUnknownValues, com.google.cloud.bigquery.storage.v1.AppendRowsRequest.MissingValueInterpretation defaultMissingValueInterpretation)
public PCollectionTuple expand(PCollection<KV<org.apache.beam.sdk.util.ShardedKey<DestinationT>,java.lang.Iterable<StorageApiWritePayload>>> input)
PTransform
PTransform
should be expanded on the given
InputT
.
NOTE: This method should not be called directly. Instead apply the PTransform
should
be applied to the InputT
using the apply
method.
Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).
expand
in class PTransform<PCollection<KV<org.apache.beam.sdk.util.ShardedKey<DestinationT>,java.lang.Iterable<StorageApiWritePayload>>>,PCollectionTuple>