- abort() - Method in interface org.apache.beam.runners.fnexecution.state.StateDelegator.Registration
-
De-registers the handler for all future requests for state for the registered process bundle
instruction id.
- absolute(String, String...) - Static method in class org.apache.beam.sdk.transforms.display.DisplayData.Path
-
Construct a path from an absolute component path hierarchy.
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlArithmeticExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.array.BeamSqlArrayExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.array.BeamSqlArrayItemExpression
-
- accept(List<BeamSqlExpression>) - Method in interface org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlBinaryOperator
-
- accept(BeamSqlExpression, BeamSqlExpression) - Method in interface org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlBinaryOperator
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlCaseExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlCastExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlCorrelVariableExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlDefaultExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlDotExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlExpression
-
assertion to make sure the input and output are supported in this expression.
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlInputRefExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlLocalRefExpression
-
- accept(List<BeamSqlExpression>) - Method in interface org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlOperator
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlOperatorExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlPrimitive
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlUdfExpression
-
- accept(List<BeamSqlExpression>) - Method in interface org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlUnaryOperator
-
- accept(BeamSqlExpression) - Method in interface org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlUnaryOperator
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlWindowEndExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlWindowExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlWindowStartExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.collection.BeamSqlCardinalityExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.collection.BeamSqlSingleElementExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlCompareExpression
-
Compare operation must have 2 operands.
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlIsNotNullExpression
-
only one operand is required.
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlIsNullExpression
-
only one operand is required.
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlCurrentDateExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlCurrentTimeExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlCurrentTimestampExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlDatetimeMinusExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlDatetimeMinusIntervalExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlDatetimePlusExpression
-
Requires exactly 2 operands.
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlIntervalMultiplyExpression
-
Requires exactly 2 operands.
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlTimestampMinusIntervalExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlTimestampMinusTimestampExpression
-
Requires exactly 2 operands.
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.logical.BeamSqlLogicalExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.map.BeamSqlMapExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.map.BeamSqlMapItemExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlMathBinaryExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlMathUnaryExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlPiExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlRandExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlRandIntegerExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret.BeamSqlReinterpretExpression
-
- accept() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.row.BeamSqlFieldAccessExpression
-
- accept(WindowedValue<T>) - Method in class org.apache.beam.sdk.fn.data.BeamFnDataBufferingOutboundObserver
-
- accept(BeamFnApi.Elements.Data) - Method in class org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver
-
- accept(T) - Method in interface org.apache.beam.sdk.fn.data.FnDataReceiver
-
- accept(T1, T2) - Method in interface org.apache.beam.sdk.fn.function.ThrowingBiConsumer
-
- accept(T) - Method in interface org.apache.beam.sdk.fn.function.ThrowingConsumer
-
- accept(T) - Method in class org.apache.beam.sdk.fn.stream.DataStreams.BlockingQueueIterator
-
- accessPattern() - Method in class org.apache.beam.runners.fnexecution.control.ProcessBundleDescriptors.SideInputSpec
-
- AccumulatingCombineFn() - Constructor for class org.apache.beam.sdk.transforms.Combine.AccumulatingCombineFn
-
- accumulatingFiredPanes() - Method in class org.apache.beam.sdk.transforms.windowing.Window
-
Returns a new Window
PTransform
that uses the registered WindowFn and
Triggering behavior, and that accumulates elements in a pane after they are triggered.
- ACCUMULATOR_NAME - Static variable in class org.apache.beam.runners.flink.metrics.FlinkMetricContainer
-
- AccumulatorCheckpointingSparkListener() - Constructor for class org.apache.beam.runners.spark.aggregators.AggregatorsAccumulator.AccumulatorCheckpointingSparkListener
-
- AccumulatorCheckpointingSparkListener() - Constructor for class org.apache.beam.runners.spark.metrics.MetricsAccumulator.AccumulatorCheckpointingSparkListener
-
- ackDeadlineSeconds(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient
-
Return the ack deadline, in seconds, for subscription
.
- ackDeadlineSeconds(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient
-
- ackDeadlineSeconds(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient
-
- acknowledge(PubsubClient.SubscriptionPath, List<String>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient
-
Acknowldege messages from subscription
with ackIds
.
- acknowledge(PubsubClient.SubscriptionPath, List<String>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient
-
- acknowledge(PubsubClient.SubscriptionPath, List<String>) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient
-
- add(MetricsContainerStepMap) - Method in class org.apache.beam.runners.flink.metrics.MetricsAccumulator
-
- add(int, GlobalWatermarkHolder.SparkWatermarks) - Static method in class org.apache.beam.runners.spark.util.GlobalWatermarkHolder
-
- add(T, long, Coder<T>) - Method in class org.apache.beam.sdk.extensions.sketching.SketchFrequencies.Sketch
-
- add(T, Coder<T>) - Method in class org.apache.beam.sdk.extensions.sketching.SketchFrequencies.Sketch
-
- add(KV<byte[], byte[]>) - Method in class org.apache.beam.sdk.extensions.sorter.BufferedExternalSorter
-
- add(List<ValueInSingleWindow<T>>, TableDataInsertAllResponse.InsertErrors, TableReference, ValueInSingleWindow<TableRow>) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.ErrorContainer
-
- add(InputT) - Method in interface org.apache.beam.sdk.state.GroupingState
-
Add a value to the buffer.
- add(Iterable<TimestampedValue<T>>) - Static method in class org.apache.beam.sdk.testing.TestStream.ElementEvent
-
For internal use only: no backwards compatibility guarantees.
- add(long) - Method in class org.apache.beam.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique
-
Adds a value to the heap, returning whether the value is (large enough to be) in the heap.
- add(DisplayData.ItemSpec<?>) - Method in interface org.apache.beam.sdk.transforms.display.DisplayData.Builder
-
Register the given display item.
- addAccum(AccumT) - Method in interface org.apache.beam.sdk.state.CombiningState
-
Add an accumulator to this state cell.
- addAccumulator(NamedAggregators, NamedAggregators) - Method in class org.apache.beam.runners.spark.aggregators.AggAccumParam
-
- addAll(Map<Integer, Queue<GlobalWatermarkHolder.SparkWatermarks>>) - Static method in class org.apache.beam.runners.spark.util.GlobalWatermarkHolder
-
- addArray(List<T>) - Method in class org.apache.beam.sdk.values.Row.Builder
-
- addArray(Object...) - Method in class org.apache.beam.sdk.values.Row.Builder
-
- addArrayField(String, Schema.FieldType) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addBoolean(Map<String, Object>, String, boolean) - Static method in class org.apache.beam.runners.dataflow.util.Structs
-
- addBooleanField(String) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addByteArrayField(String) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addByteField(String) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addCollectionToSingletonOutput(PCollection<?>, String, PCollectionView<?>) - Method in interface org.apache.beam.runners.dataflow.TransformTranslator.StepTranslationContext
-
Adds an output to this CollectionToSingleton
Dataflow step, consuming the specified
input PValue
and producing the specified output PValue
.
- addDataSet(String, DataSet<T>) - Method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator.BatchTranslationContext
-
- addDataStream(String, DataStream<T>) - Method in class org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator.StreamingTranslationContext
-
- addDateTimeField(String) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addDecimalField(String) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addDictionary(Map<String, Object>, String, Map<String, Object>) - Static method in class org.apache.beam.runners.dataflow.util.Structs
-
- addDouble(Map<String, Object>, String, Double) - Static method in class org.apache.beam.runners.dataflow.util.Structs
-
- addDoubleField(String) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addElements(T, T...) - Method in class org.apache.beam.sdk.testing.TestStream.Builder
-
Adds the specified elements to the source with timestamp equal to the current watermark.
- addElements(TimestampedValue<T>, TimestampedValue<T>...) - Method in class org.apache.beam.sdk.testing.TestStream.Builder
-
Adds the specified elements to the source with the provided timestamps.
- addEncodingInput(Coder<?>) - Method in interface org.apache.beam.runners.dataflow.TransformTranslator.StepTranslationContext
-
Sets the encoding for this Dataflow step.
- addField(Schema.Field) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addField(String, Schema.FieldType) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addFields(List<Schema.Field>) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addFields(Schema.Field...) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addFloatField(String) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addIfAbsent(T) - Method in interface org.apache.beam.sdk.state.SetState
-
Ensures a value is a member of the set, returning true
if it was added and false
otherwise.
- addIfNotDefault(DisplayData.ItemSpec<T>, T) - Method in interface org.apache.beam.sdk.transforms.display.DisplayData.Builder
-
Register the given display item if the value is different than the specified default.
- addIfNotNull(DisplayData.ItemSpec<?>) - Method in interface org.apache.beam.sdk.transforms.display.DisplayData.Builder
-
Register the given display item if the value is not null.
- addInPlace(NamedAggregators, NamedAggregators) - Method in class org.apache.beam.runners.spark.aggregators.AggAccumParam
-
- addInput(String, Boolean) - Method in interface org.apache.beam.runners.dataflow.TransformTranslator.StepTranslationContext
-
Adds an input with the given name and value to this Dataflow step.
- addInput(String, String) - Method in interface org.apache.beam.runners.dataflow.TransformTranslator.StepTranslationContext
-
Adds an input with the given name and value to this Dataflow step.
- addInput(String, Long) - Method in interface org.apache.beam.runners.dataflow.TransformTranslator.StepTranslationContext
-
Adds an input with the given name and value to this Dataflow step.
- addInput(String, PInput) - Method in interface org.apache.beam.runners.dataflow.TransformTranslator.StepTranslationContext
-
Adds an input with the given name to this Dataflow step, coming from the specified input
PValue.
- addInput(String, Map<String, Object>) - Method in interface org.apache.beam.runners.dataflow.TransformTranslator.StepTranslationContext
-
Adds an input that is a dictionary of strings to objects.
- addInput(String, List<? extends Map<String, Object>>) - Method in interface org.apache.beam.runners.dataflow.TransformTranslator.StepTranslationContext
-
Adds an input that is a list of objects.
- addInput(HyperLogLogPlus, InputT) - Method in class org.apache.beam.sdk.extensions.sketching.ApproximateDistinct.ApproximateDistinctFn
-
- addInput(SketchFrequencies.Sketch<InputT>, InputT) - Method in class org.apache.beam.sdk.extensions.sketching.SketchFrequencies.CountMinSketchFn
-
- addInput(MergingDigest, Double) - Method in class org.apache.beam.sdk.extensions.sketching.TDigestQuantiles.TDigestQuantilesFn
-
- addInput(CovarianceAccumulator, KV<T, T>) - Method in class org.apache.beam.sdk.extensions.sql.impl.transform.agg.CovarianceFn
-
- addInput(VarianceAccumulator, T) - Method in class org.apache.beam.sdk.extensions.sql.impl.transform.agg.VarianceFn
-
- addInput(BeamAggregationTransforms.AggregationAccumulator, Row) - Method in class org.apache.beam.sdk.extensions.sql.impl.transform.BeamAggregationTransforms.AggregationAdaptor
-
- addInput(ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique, T) - Method in class org.apache.beam.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
-
- addInput(InputT) - Method in interface org.apache.beam.sdk.transforms.Combine.AccumulatingCombineFn.Accumulator
-
Adds the given input value to this accumulator, modifying this accumulator.
- addInput(AccumT, InputT) - Method in class org.apache.beam.sdk.transforms.Combine.AccumulatingCombineFn
-
- addInput(double[], Double) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineDoubleFn
-
- addInput(Combine.Holder<V>, V) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineFn
-
- addInput(int[], Integer) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineIntegerFn
-
- addInput(long[], Long) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineLongFn
-
- addInput(AccumT, InputT) - Method in class org.apache.beam.sdk.transforms.Combine.CombineFn
-
Adds the given input value to the given accumulator, returning the new accumulator value.
- addInput(List<V>, V) - Method in class org.apache.beam.sdk.transforms.Combine.IterableCombineFn
-
- addInput(Object[], DataT) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFn
-
- addInput(Object[], DataT, CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFnWithContext
-
- addInput(AccumT, InputT, CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineWithContext.CombineFnWithContext
-
Adds the given input value to the given accumulator, returning the new accumulator value.
- addInput(Top.BoundedHeap<KV<Integer, T>, SerializableComparator<KV<Integer, T>>>, T) - Method in class org.apache.beam.sdk.transforms.Sample.FixedSizedSampleFn
-
- addInt16Field(String) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addInt32Field(String) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addInt64Field(String) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addLengthPrefixedCoder(String, RunnerApi.Components.Builder, boolean) - Static method in class org.apache.beam.runners.fnexecution.wire.LengthPrefixUnknownCoders
-
- addList(Map<String, Object>, String, List<? extends Map<String, Object>>) - Static method in class org.apache.beam.runners.dataflow.util.Structs
-
- addList(Map<String, Object>, String, T[]) - Static method in class org.apache.beam.runners.dataflow.util.Structs
-
- addLong(Map<String, Object>, String, long) - Static method in class org.apache.beam.runners.dataflow.util.Structs
-
- addLongs(Map<String, Object>, String, long...) - Static method in class org.apache.beam.runners.dataflow.util.Structs
-
- addMapField(String, Schema.FieldType, Schema.FieldType) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addMessage(Message) - Method in class org.apache.beam.sdk.io.jms.JmsCheckpointMark
-
- addMessageListener(Consumer<JobApi.JobMessage>) - Method in class org.apache.beam.runners.flink.FlinkJobInvocation
-
- addMessageListener(Consumer<JobApi.JobMessage>) - Method in interface org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation
-
Listen for job messages with a Consumer
.
- addNameFilter(MetricNameFilter) - Method in class org.apache.beam.sdk.metrics.MetricsFilter.Builder
-
- addNull(Map<String, Object>, String) - Static method in class org.apache.beam.runners.dataflow.util.Structs
-
- addNullableField(String, Schema.FieldType) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addObject(Map<String, Object>, String, Map<String, Object>) - Static method in class org.apache.beam.runners.dataflow.util.Structs
-
- addOutput(String, PCollection<?>) - Method in interface org.apache.beam.runners.dataflow.TransformTranslator.StepTranslationContext
-
Adds a primitive output to this Dataflow step with the given name as the local output name,
producing the specified output PValue
, including its Coder
if a TypedPValue
.
- addOverrideForClass(Class<?>, DataflowWorkerLoggingOptions.Level) - Method in class org.apache.beam.runners.dataflow.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverrides
-
Deprecated.
Overrides the default log level for the passed in class.
- addOverrideForClass(Class<?>, SdkHarnessOptions.LogLevel) - Method in class org.apache.beam.sdk.options.SdkHarnessOptions.SdkHarnessLogLevelOverrides
-
Overrides the default log level for the passed in class.
- addOverrideForName(String, DataflowWorkerLoggingOptions.Level) - Method in class org.apache.beam.runners.dataflow.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverrides
-
Deprecated.
Overrides the default log level for the passed in name.
- addOverrideForName(String, SdkHarnessOptions.LogLevel) - Method in class org.apache.beam.sdk.options.SdkHarnessOptions.SdkHarnessLogLevelOverrides
-
Overrides the default log logLevel for the passed in name.
- addOverrideForPackage(Package, DataflowWorkerLoggingOptions.Level) - Method in class org.apache.beam.runners.dataflow.options.DataflowWorkerLoggingOptions.WorkerLogLevelOverrides
-
Deprecated.
Overrides the default log level for the passed in package.
- addOverrideForPackage(Package, SdkHarnessOptions.LogLevel) - Method in class org.apache.beam.sdk.options.SdkHarnessOptions.SdkHarnessLogLevelOverrides
-
Overrides the default log level for the passed in package.
- addProperties(Configuration, Properties) - Static method in class org.apache.beam.runners.apex.ApexYarnLauncher
-
Transfer the properties to the configuration object.
- addRowField(String, Schema) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addRows(String, Row...) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.test.TestTableProvider
-
- addRunnerWireCoder(PipelineNode.PCollectionNode, RunnerApi.Components.Builder) - Static method in class org.apache.beam.runners.fnexecution.wire.WireCoders
-
Creates a runner-side wire coder for a port read/write for the given PCollection.
- addSdkWireCoder(PipelineNode.PCollectionNode, RunnerApi.Components.Builder) - Static method in class org.apache.beam.runners.fnexecution.wire.WireCoders
-
Creates an SDK-side wire coder for a port read/write for the given PCollection.
- addStateListener(Consumer<JobApi.JobState.Enum>) - Method in class org.apache.beam.runners.flink.FlinkJobInvocation
-
- addStateListener(Consumer<JobApi.JobState.Enum>) - Method in interface org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation
-
Listen for job state changes with a Consumer
.
- addStep(PTransform<?, ?>, String) - Method in interface org.apache.beam.runners.dataflow.TransformTranslator.TranslationContext
-
Adds a step to the Dataflow workflow for the given transform, with the given Dataflow step
type.
- addStep(String) - Method in class org.apache.beam.sdk.metrics.MetricsFilter.Builder
-
Add a step filter.
- addString(Map<String, Object>, String, String) - Static method in class org.apache.beam.runners.dataflow.util.Structs
-
- addStringField(String) - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- addStringList(Map<String, Object>, String, List<String>) - Static method in class org.apache.beam.runners.dataflow.util.Structs
-
- addTraceFor(AbstractGoogleClient, String) - Method in class org.apache.beam.sdk.extensions.gcp.options.GoogleApiDebugOptions.GoogleApiTracer
-
- addTraceFor(AbstractGoogleClientRequest<?>, String) - Method in class org.apache.beam.sdk.extensions.gcp.options.GoogleApiDebugOptions.GoogleApiTracer
-
- addValue(Object) - Method in class org.apache.beam.sdk.values.Row.Builder
-
- addValues(List<Object>) - Method in class org.apache.beam.sdk.values.Row.Builder
-
- addValues(Object...) - Method in class org.apache.beam.sdk.values.Row.Builder
-
- advance() - Method in class org.apache.beam.runners.spark.io.MicrobatchSource.Reader
-
- advance(String) - Static method in class org.apache.beam.runners.spark.util.GlobalWatermarkHolder
-
Advances the watermarks to the next-in-line watermarks.
- advance() - Static method in class org.apache.beam.runners.spark.util.GlobalWatermarkHolder
-
- advance() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
- advance() - Method in class org.apache.beam.sdk.io.Source.Reader
-
Advances the reader to the next valid record.
- advance() - Method in class org.apache.beam.sdk.io.UnboundedSource.UnboundedReader
-
Advances the reader to the next valid record.
- advanceBy(Duration) - Static method in class org.apache.beam.sdk.testing.TestStream.ProcessingTimeEvent
-
For internal use only: no backwards compatibility guarantees.
- advanceImpl() - Method in class org.apache.beam.sdk.io.FileBasedSource.FileBasedReader
-
- advanceImpl() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
Advances to the next record and returns true
, or returns false if there is no next
record.
- advanceNextBatchWatermarkToInfinity() - Method in class org.apache.beam.runners.spark.io.CreateStream
-
Advances the watermark in the next batch to the end-of-time.
- advanceProcessingTime(Duration) - Method in class org.apache.beam.sdk.testing.TestStream.Builder
-
Advance the processing time by the specified amount.
- advanceTo(Instant) - Static method in class org.apache.beam.sdk.testing.TestStream.WatermarkEvent
-
For internal use only: no backwards compatibility guarantees.
- advanceWatermark() - Method in class org.apache.beam.runners.spark.stateful.SparkTimerInternals
-
Advances the watermark.
- advanceWatermarkForNextBatch(Instant) - Method in class org.apache.beam.runners.spark.io.CreateStream
-
Advances the watermark in the next batch.
- advanceWatermarkTo(Instant) - Method in class org.apache.beam.sdk.testing.TestStream.Builder
-
Advance the watermark of this source to the specified instant.
- advanceWatermarkToInfinity() - Method in class org.apache.beam.sdk.testing.TestStream.Builder
-
Advance the watermark to infinity, completing this
TestStream
.
- AdvancingPhaser - Class in org.apache.beam.sdk.fn.stream
-
A Phaser
which never terminates.
- AdvancingPhaser(int) - Constructor for class org.apache.beam.sdk.fn.stream.AdvancingPhaser
-
- AfterAll - Class in org.apache.beam.sdk.transforms.windowing
-
A composite
Trigger
that fires when all of its sub-triggers are ready.
- AfterEach - Class in org.apache.beam.sdk.transforms.windowing
-
A composite
Trigger
that executes its sub-triggers in order.
- AfterFirst - Class in org.apache.beam.sdk.transforms.windowing
-
A composite
Trigger
that fires once after at least one of its sub-triggers have fired.
- AfterPane - Class in org.apache.beam.sdk.transforms.windowing
-
A
Trigger
that fires at some point after a specified number of input elements have
arrived.
- AfterProcessingTime - Class in org.apache.beam.sdk.transforms.windowing
-
A
Trigger
trigger that fires at a specified point in processing time, relative to when
input first arrives.
- AfterSynchronizedProcessingTime - Class in org.apache.beam.sdk.transforms.windowing
-
FOR INTERNAL USE ONLY.
- afterTimeSinceNewOutput(ReadableDuration) - Static method in class org.apache.beam.sdk.transforms.Watch.Growth
-
- afterTimeSinceNewOutput(SerializableFunction<InputT, ReadableDuration>) - Static method in class org.apache.beam.sdk.transforms.Watch.Growth
-
- afterTotalOf(ReadableDuration) - Static method in class org.apache.beam.sdk.transforms.Watch.Growth
-
- afterTotalOf(SerializableFunction<InputT, ReadableDuration>) - Static method in class org.apache.beam.sdk.transforms.Watch.Growth
-
- AfterWatermark - Class in org.apache.beam.sdk.transforms.windowing
-
AfterWatermark
triggers fire based on progress of the system watermark.
- AfterWatermark.AfterWatermarkEarlyAndLate - Class in org.apache.beam.sdk.transforms.windowing
-
- AfterWatermark.FromEndOfWindow - Class in org.apache.beam.sdk.transforms.windowing
-
A watermark trigger targeted relative to the end of the window.
- AggAccumParam - Class in org.apache.beam.runners.spark.aggregators
-
Aggregator accumulator param.
- AggAccumParam() - Constructor for class org.apache.beam.runners.spark.aggregators.AggAccumParam
-
- AggregateWindowField - Class in org.apache.beam.sdk.extensions.sql.impl.rule
-
For internal use only; no backwards compatibility guarantees.
- AggregateWindowField() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rule.AggregateWindowField
-
- AggregationAccumulator() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.transform.BeamAggregationTransforms.AggregationAccumulator
-
- AggregationAccumulatorCoder(List<Coder>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.transform.BeamAggregationTransforms.AggregationAccumulatorCoder
-
- AggregationAdaptor(List<Pair<AggregateCall, String>>, Schema) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.transform.BeamAggregationTransforms.AggregationAdaptor
-
- AggregationGroupByKeyFn(Schema, int, ImmutableBitSet) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.transform.BeamAggregationTransforms.AggregationGroupByKeyFn
-
- AggregatorMetric - Class in org.apache.beam.runners.spark.metrics
-
- AggregatorMetricSource - Class in org.apache.beam.runners.spark.metrics
-
- AggregatorMetricSource(String, NamedAggregators) - Constructor for class org.apache.beam.runners.spark.metrics.AggregatorMetricSource
-
- AggregatorsAccumulator - Class in org.apache.beam.runners.spark.aggregators
-
For resilience, Accumulators
are required to be wrapped in a Singleton.
- AggregatorsAccumulator() - Constructor for class org.apache.beam.runners.spark.aggregators.AggregatorsAccumulator
-
- AggregatorsAccumulator.AccumulatorCheckpointingSparkListener - Class in org.apache.beam.runners.spark.aggregators
-
- align(Duration) - Method in interface org.apache.beam.sdk.state.Timer
-
- alignedTo(Duration, Instant) - Method in class org.apache.beam.sdk.transforms.windowing.AfterProcessingTime
-
Aligns timestamps to the smallest multiple of period
since the offset
greater
than the timestamp.
- alignedTo(Duration) - Method in class org.apache.beam.sdk.transforms.windowing.AfterProcessingTime
-
Aligns the time to be the smallest multiple of period
greater than the epoch boundary
(aka new Instant(0)
).
- alignTo(Duration, Instant) - Static method in class org.apache.beam.sdk.transforms.windowing.TimestampTransform
-
For internal use only; no backwards-compatibility guarantees.
- alignTo(Duration) - Static method in class org.apache.beam.sdk.transforms.windowing.TimestampTransform
-
For internal use only; no backwards-compatibility guarantees.
- AlignTo() - Constructor for class org.apache.beam.sdk.transforms.windowing.TimestampTransform.AlignTo
-
- ALL_CONTEXTS - Static variable in class org.apache.beam.sdk.testing.CoderProperties
-
All the contexts, for use in test cases.
- ALL_KEYS - Static variable in class org.apache.beam.sdk.io.range.ByteKeyRange
-
The range of all keys, with empty start and end keys.
- allFields() - Method in class org.apache.beam.sdk.schemas.FieldAccessDescriptor
-
- allMatches(String) - Static method in class org.apache.beam.sdk.transforms.Regex
-
- allMatches(Pattern) - Static method in class org.apache.beam.sdk.transforms.Regex
-
- AllMatches(Pattern) - Constructor for class org.apache.beam.sdk.transforms.Regex.AllMatches
-
- allocatePortAndCreate(BindableService, Endpoints.ApiServiceDescriptor.Builder) - Method in class org.apache.beam.runners.fnexecution.InProcessServerFactory
-
- allocatePortAndCreate(BindableService, Endpoints.ApiServiceDescriptor.Builder) - Method in class org.apache.beam.runners.fnexecution.ServerFactory
-
Creates an instance of this server using an ephemeral port chosen automatically.
- allocatePortAndCreate(BindableService, Endpoints.ApiServiceDescriptor.Builder) - Method in class org.apache.beam.runners.fnexecution.ServerFactory.InetSocketAddressServerFactory
-
- allocatePortAndCreateFor(ServiceT, ServerFactory) - Static method in class org.apache.beam.runners.fnexecution.GrpcFnServer
-
- allOf(Watch.Growth.TerminationCondition<InputT, FirstStateT>, Watch.Growth.TerminationCondition<InputT, SecondStateT>) - Static method in class org.apache.beam.sdk.transforms.Watch.Growth
-
- allowsDynamicSplitting() - Method in class org.apache.beam.sdk.io.CompressedSource.CompressedReader
-
- allowsDynamicSplitting() - Method in class org.apache.beam.sdk.io.FileBasedSource.FileBasedReader
-
- allowsDynamicSplitting() - Method in class org.apache.beam.sdk.io.OffsetBasedSource.OffsetBasedReader
-
Whether this reader should allow dynamic splitting of the offset ranges.
- AlwaysPassMatcher() - Constructor for class org.apache.beam.sdk.testing.TestPipelineOptions.AlwaysPassMatcher
-
- AlwaysPassMatcherFactory() - Constructor for class org.apache.beam.sdk.testing.TestPipelineOptions.AlwaysPassMatcherFactory
-
- alwaysRetry() - Static method in class org.apache.beam.sdk.io.gcp.bigquery.InsertRetryPolicy
-
Always retry all failures.
- AmqpIO - Class in org.apache.beam.sdk.io.amqp
-
AmqpIO supports AMQP 1.0 protocol using the Apache QPid Proton-J library.
- AmqpIO.Read - Class in org.apache.beam.sdk.io.amqp
-
A
PTransform
to read/receive messages using AMQP 1.0 protocol.
- AmqpIO.Write - Class in org.apache.beam.sdk.io.amqp
-
A
PTransform
to send messages using AMQP 1.0 protocol.
- AmqpMessageCoder - Class in org.apache.beam.sdk.io.amqp
-
A coder for AMQP message.
- AmqpMessageCoder() - Constructor for class org.apache.beam.sdk.io.amqp.AmqpMessageCoder
-
- AmqpMessageCoderProviderRegistrar - Class in org.apache.beam.sdk.io.amqp
-
- AmqpMessageCoderProviderRegistrar() - Constructor for class org.apache.beam.sdk.io.amqp.AmqpMessageCoderProviderRegistrar
-
- and(TupleTag<V>, List<V>) - Method in class org.apache.beam.sdk.transforms.join.CoGbkResult
-
Returns a new
CoGbkResult
based on this, with the given tag and given data added to it.
- and(TupleTag<V>, PCollection<KV<K, V>>) - Method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple
-
Returns a new KeyedPCollectionTuple<K>
that is the same as this, appended with the
given PCollection.
- and(PCollection.IsBounded) - Method in enum org.apache.beam.sdk.values.PCollection.IsBounded
-
Returns the composed IsBounded property.
- and(PCollection<T>) - Method in class org.apache.beam.sdk.values.PCollectionList
-
- and(Iterable<PCollection<T>>) - Method in class org.apache.beam.sdk.values.PCollectionList
-
- and(TupleTag<T>, PCollection<T>) - Method in class org.apache.beam.sdk.values.PCollectionTuple
-
- and(TupleTag<?>) - Method in class org.apache.beam.sdk.values.TupleTagList
-
- and(List<TupleTag<?>>) - Method in class org.apache.beam.sdk.values.TupleTagList
-
- any(long) - Static method in class org.apache.beam.sdk.transforms.Sample
-
Sample#any(long)
takes a PCollection<T>
and a limit, and produces a new PCollection<T>
containing up to limit elements of the input PCollection
.
- anyCombineFn(int) - Static method in class org.apache.beam.sdk.transforms.Sample
-
Returns a
Combine.CombineFn
that computes a fixed-sized potentially non-uniform sample of its
inputs.
- ApexPipelineOptions - Interface in org.apache.beam.runners.apex
-
Options that configure the Apex pipeline.
- ApexRunner - Class in org.apache.beam.runners.apex
-
A
PipelineRunner
that translates the pipeline to an Apex DAG and executes it on an Apex
cluster.
- ApexRunner(ApexPipelineOptions) - Constructor for class org.apache.beam.runners.apex.ApexRunner
-
- ApexRunner.CreateApexPCollectionView<ElemT,ViewT> - Class in org.apache.beam.runners.apex
-
- ApexRunnerRegistrar - Class in org.apache.beam.runners.apex
-
- ApexRunnerRegistrar.Options - Class in org.apache.beam.runners.apex
-
- ApexRunnerRegistrar.Runner - Class in org.apache.beam.runners.apex
-
- ApexRunnerResult - Class in org.apache.beam.runners.apex
-
Result of executing a
Pipeline
with Apex in embedded mode.
- ApexRunnerResult(DAG, Launcher.AppHandle) - Constructor for class org.apache.beam.runners.apex.ApexRunnerResult
-
- ApexYarnLauncher - Class in org.apache.beam.runners.apex
-
Proxy to launch the YARN application through the hadoop script to run in the pre-configured
environment (class path, configuration, native libraries etc.).
- ApexYarnLauncher() - Constructor for class org.apache.beam.runners.apex.ApexYarnLauncher
-
- ApexYarnLauncher.LaunchParams - Class in org.apache.beam.runners.apex
-
Launch parameters that will be serialized and passed to the child process.
- ApexYarnLauncher.ProcessWatcher - Class in org.apache.beam.runners.apex
-
Starts a command and waits for it to complete.
- append(K, W, Iterator<V>) - Method in interface org.apache.beam.runners.fnexecution.state.StateRequestHandlers.BagUserStateHandler
-
Appends the values to the bag user state for the given key and window.
- applicableTo(PCollection<?>) - Static method in class org.apache.beam.sdk.transforms.GroupByKey
-
- ApplicationNameOptions - Interface in org.apache.beam.sdk.options
-
Options that allow setting the application name.
- apply(WindowFunction.Context<T2>) - Method in class org.apache.beam.runners.gearpump.translators.GroupByKeyTranslator.GearpumpWindowFn
-
- apply(InputT) - Method in interface org.apache.beam.sdk.coders.DelegateCoder.CodingFunction
-
- apply(List<BeamSqlPrimitive>) - Method in interface org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlBinaryOperator
-
- apply(BeamSqlPrimitive, BeamSqlPrimitive) - Method in interface org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlBinaryOperator
-
- apply(List<BeamSqlPrimitive>) - Method in interface org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlOperator
-
- apply(List<BeamSqlPrimitive>) - Method in interface org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlUnaryOperator
-
- apply(BeamSqlPrimitive) - Method in interface org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlUnaryOperator
-
- apply(Row) - Method in class org.apache.beam.sdk.extensions.sql.impl.transform.BeamAggregationTransforms.AggregationGroupByKeyFn
-
- apply(Row) - Method in class org.apache.beam.sdk.extensions.sql.impl.transform.BeamAggregationTransforms.WindowTimestampFn
-
- apply(Row) - Method in class org.apache.beam.sdk.extensions.sql.impl.transform.BeamJoinTransforms.ExtractJoinFields
-
- apply(KV<Row, KV<Row, Row>>) - Method in class org.apache.beam.sdk.extensions.sql.impl.transform.BeamJoinTransforms.JoinParts2WholeRow
-
- apply(Row) - Method in class org.apache.beam.sdk.extensions.sql.impl.transform.BeamSetOperatorsTransforms.BeamSqlRow2KvFn
-
- apply(T1, T2) - Method in interface org.apache.beam.sdk.fn.function.ThrowingBiFunction
-
- apply(T1) - Method in interface org.apache.beam.sdk.fn.function.ThrowingFunction
-
- apply(Statement, Description) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TestBigQuery
-
- apply(Statement, Description) - Method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsub
-
- apply(Statement, Description) - Method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsubSignal
-
- apply(SQLException) - Method in class org.apache.beam.sdk.io.jdbc.JdbcIO.DefaultRetryStrategy
-
- apply(SQLException) - Method in interface org.apache.beam.sdk.io.jdbc.JdbcIO.RetryStrategy
-
- apply(PTransform<? super PBegin, OutputT>) - Method in class org.apache.beam.sdk.Pipeline
-
- apply(String, PTransform<? super PBegin, OutputT>) - Method in class org.apache.beam.sdk.Pipeline
-
- apply(T) - Method in class org.apache.beam.sdk.testing.PAssert.PCollectionContentsAssert.MatcherCheckerFn
-
- apply(Statement, Description) - Method in class org.apache.beam.sdk.testing.TestPipeline
-
- apply(double, double) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineDoubleFn
-
Applies the binary operation to the two operands, returning the result.
- apply(V, V) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineFn
-
Applies the binary operation to the two operands, returning the result.
- apply(int, int) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineIntegerFn
-
Applies the binary operation to the two operands, returning the result.
- apply(long, long) - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineLongFn
-
Applies the binary operation to the two operands, returning the result.
- apply(Iterable<? extends InputT>) - Method in class org.apache.beam.sdk.transforms.Combine.CombineFn
-
Applies this CombineFn
to a collection of input values to produce a combined output
value.
- apply(Iterable<? extends InputT>, CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineWithContext.CombineFnWithContext
-
Applies this CombineFnWithContext
to a collection of input values to produce a
combined output value.
- apply(InputT, Contextful.Fn.Context) - Method in interface org.apache.beam.sdk.transforms.Contextful.Fn
-
Invokes the function on the given input with the given context.
- apply(PTransform<KeyedPCollectionTuple<K>, OutputT>) - Method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple
-
- apply(String, PTransform<KeyedPCollectionTuple<K>, OutputT>) - Method in class org.apache.beam.sdk.transforms.join.KeyedPCollectionTuple
-
Applies the given
PTransform
to this input
KeyedPCollectionTuple
and returns
its
OutputT
.
- apply(InputT) - Method in interface org.apache.beam.sdk.transforms.SerializableFunction
-
Returns the result of invoking this function on the given input.
- apply(InputT) - Method in class org.apache.beam.sdk.transforms.SimpleFunction
-
- apply(PrimitiveViewT) - Method in class org.apache.beam.sdk.transforms.ViewFn
-
A function to adapt a primitive view type to a desired view type.
- apply(PTransform<? super PBegin, OutputT>) - Method in class org.apache.beam.sdk.values.PBegin
-
- apply(String, PTransform<? super PBegin, OutputT>) - Method in class org.apache.beam.sdk.values.PBegin
-
Applies the given
PTransform
to this
PBegin
, using
name
to identify
this specific application of the transform.
- apply(PTransform<? super PCollection<T>, OutputT>) - Method in class org.apache.beam.sdk.values.PCollection
-
- apply(String, PTransform<? super PCollection<T>, OutputT>) - Method in class org.apache.beam.sdk.values.PCollection
-
Applies the given
PTransform
to this input
PCollection
, using
name
to
identify this specific application of the transform.
- apply(PTransform<PCollectionList<T>, OutputT>) - Method in class org.apache.beam.sdk.values.PCollectionList
-
- apply(String, PTransform<PCollectionList<T>, OutputT>) - Method in class org.apache.beam.sdk.values.PCollectionList
-
Applies the given
PTransform
to this input
PCollectionList
, using
name
to identify this specific application of the transform.
- apply(PTransform<? super PCollectionTuple, OutputT>) - Method in class org.apache.beam.sdk.values.PCollectionTuple
-
- apply(String, PTransform<? super PCollectionTuple, OutputT>) - Method in class org.apache.beam.sdk.values.PCollectionTuple
-
- apply(Materializations.MultimapView<Void, T>) - Method in class org.apache.beam.sdk.values.PCollectionViews.IterableViewFn
-
- apply(Materializations.MultimapView<Void, T>) - Method in class org.apache.beam.sdk.values.PCollectionViews.ListViewFn
-
- apply(Materializations.MultimapView<Void, KV<K, V>>) - Method in class org.apache.beam.sdk.values.PCollectionViews.MapViewFn
-
- apply(Materializations.MultimapView<Void, KV<K, V>>) - Method in class org.apache.beam.sdk.values.PCollectionViews.MultimapViewFn
-
- apply(Materializations.MultimapView<Void, T>) - Method in class org.apache.beam.sdk.values.PCollectionViews.SingletonViewFn
-
- applyTransform(InputT, PTransform<? super InputT, OutputT>) - Static method in class org.apache.beam.sdk.Pipeline
-
For internal use only; no backwards-compatibility guarantees.
- applyTransform(String, InputT, PTransform<? super InputT, OutputT>) - Static method in class org.apache.beam.sdk.Pipeline
-
For internal use only; no backwards-compatibility guarantees.
- ApproximateDistinct - Class in org.apache.beam.sdk.extensions.sketching
-
PTransform
s for computing the approximate number of distinct elements in a stream.
- ApproximateDistinct() - Constructor for class org.apache.beam.sdk.extensions.sketching.ApproximateDistinct
-
- ApproximateDistinct.ApproximateDistinctFn<InputT> - Class in org.apache.beam.sdk.extensions.sketching
-
- ApproximateDistinct.GloballyDistinct<InputT> - Class in org.apache.beam.sdk.extensions.sketching
-
- ApproximateDistinct.HyperLogLogPlusCoder - Class in org.apache.beam.sdk.extensions.sketching
-
Coder for HyperLogLogPlus
class.
- ApproximateDistinct.PerKeyDistinct<K,V> - Class in org.apache.beam.sdk.extensions.sketching
-
- ApproximateQuantiles - Class in org.apache.beam.sdk.transforms
-
PTransform
s for getting an idea of a PCollection
's data distribution using
approximate N
-tiles (e.g.
- ApproximateQuantiles.ApproximateQuantilesCombineFn<T,ComparatorT extends java.util.Comparator<T> & java.io.Serializable> - Class in org.apache.beam.sdk.transforms
-
The ApproximateQuantilesCombineFn
combiner gives an idea of the distribution of a
collection of values using approximate N
-tiles.
- ApproximateUnique - Class in org.apache.beam.sdk.transforms
-
PTransform
s for estimating the number of distinct elements in a PCollection
, or
the number of distinct values associated with each key in a PCollection
of KV
s.
- ApproximateUnique() - Constructor for class org.apache.beam.sdk.transforms.ApproximateUnique
-
- ApproximateUnique.ApproximateUniqueCombineFn<T> - Class in org.apache.beam.sdk.transforms
-
CombineFn
that computes an estimate of the number of distinct values that were
combined.
- ApproximateUnique.ApproximateUniqueCombineFn.LargestUnique - Class in org.apache.beam.sdk.transforms
-
A heap utility class to efficiently track the largest added elements.
- ApproximateUniqueCombineFn(long, Coder<T>) - Constructor for class org.apache.beam.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
-
- array() - Method in class org.apache.beam.runners.dataflow.util.RandomAccessData
-
Returns the backing array.
- array(Schema.FieldType) - Static method in class org.apache.beam.sdk.schemas.Schema.FieldType
-
Create an array type for the given field type.
- ArtifactRetrievalService - Interface in org.apache.beam.runners.fnexecution.artifact
-
An implementation of the Beam Artifact Retrieval Service.
- ARTIFACTS - Static variable in class org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
-
- as(Class<T>) - Method in interface org.apache.beam.sdk.options.PipelineOptions
-
Transforms this object into an object of type <T>
saving each property that has been
manipulated.
- as(Class<T>) - Static method in class org.apache.beam.sdk.options.PipelineOptionsFactory
-
Creates and returns an object that implements <T>
.
- as(Class<T>) - Method in class org.apache.beam.sdk.options.PipelineOptionsFactory.Builder
-
Creates and returns an object that implements <T>
using the values configured on this
builder during construction.
- asCloudObject(Coder<?>) - Static method in class org.apache.beam.runners.dataflow.util.CloudObjects
-
- asInputStream(int, int) - Method in class org.apache.beam.runners.dataflow.util.RandomAccessData
-
Returns an InputStream
wrapper which supplies the portion of this backing byte buffer
starting at offset
and up to length
bytes.
- asIterable() - Static method in class org.apache.beam.sdk.transforms.View
-
- AsJsons<InputT> - Class in org.apache.beam.sdk.extensions.jackson
-
PTransform
for serializing objects to JSON
Strings
.
- asList() - Static method in class org.apache.beam.sdk.transforms.View
-
- asMap() - Method in class org.apache.beam.sdk.transforms.display.DisplayData
-
- asMap() - Static method in class org.apache.beam.sdk.transforms.View
-
- asMultimap() - Static method in class org.apache.beam.sdk.transforms.View
-
- asOutputReference(PValue, AppliedPTransform<?, ?, ?>) - Method in interface org.apache.beam.runners.dataflow.TransformTranslator.TranslationContext
-
Encode a PValue reference as an output reference.
- asOutputStream() - Method in class org.apache.beam.runners.dataflow.util.RandomAccessData
-
Returns an output stream which writes to the backing buffer from the current position.
- asPath() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubSubscription
-
Returns the string representation of this subscription as a path used in the Cloud Pub/Sub
API.
- asPath() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubTopic
-
Returns the string representation of this topic as a path used in the Cloud Pub/Sub API.
- asResponseObserver() - Method in class org.apache.beam.runners.fnexecution.control.FnApiControlClient
-
- ASSERTION_ERROR - Static variable in class org.apache.beam.runners.apex.ApexRunner
-
TODO: this isn't thread safe and may cause issues when tests run in parallel Holds any most
resent assertion error that was raised while processing elements.
- assertionError() - Method in class org.apache.beam.sdk.testing.SuccessOrFailure
-
- assertSourcesEqualReferenceSource(BoundedSource<T>, List<? extends BoundedSource<T>>, PipelineOptions) - Static method in class org.apache.beam.sdk.testing.SourceTestUtils
-
Given a reference Source
and a list of Source
s, assert that the union of the
records read from the list of sources is equal to the records read from the reference source.
- assertSplitAtFractionBehavior(BoundedSource<T>, int, double, SourceTestUtils.ExpectedSplitOutcome, PipelineOptions) - Static method in class org.apache.beam.sdk.testing.SourceTestUtils
-
- assertSplitAtFractionExhaustive(BoundedSource<T>, PipelineOptions) - Static method in class org.apache.beam.sdk.testing.SourceTestUtils
-
Asserts that for each possible start position, BoundedSource.BoundedReader#splitAtFraction
at every interesting fraction (halfway between two
fractions that differ by at least one item) can be called successfully and the results are
consistent if a split succeeds.
- assertSplitAtFractionFails(BoundedSource<T>, int, double, PipelineOptions) - Static method in class org.apache.beam.sdk.testing.SourceTestUtils
-
Asserts that the source
's reader fails to splitAtFraction(fraction)
after
reading numItemsToReadBeforeSplit
items.
- assertSplitAtFractionSucceedsAndConsistent(BoundedSource<T>, int, double, PipelineOptions) - Static method in class org.apache.beam.sdk.testing.SourceTestUtils
-
Verifies some consistency properties of BoundedSource.BoundedReader#splitAtFraction
on
the given source.
- assertThatAllRows(Schema) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TestBigQuery
-
- assertUnstartedReaderReadsSameAsItsSource(BoundedSource.BoundedReader<T>, PipelineOptions) - Static method in class org.apache.beam.sdk.testing.SourceTestUtils
-
Assert that a Reader
returns a Source
that, when read from, produces the same
records as the reader.
- assign(BoundedWindow, Instant) - Method in enum org.apache.beam.sdk.transforms.windowing.TimestampCombiner
-
- assignableTo(Schema) - Method in class org.apache.beam.sdk.schemas.Schema
-
Returns true if this Schema can be assigned to another Schema.
- assignableToIgnoreNullable(Schema) - Method in class org.apache.beam.sdk.schemas.Schema
-
Returns true if this Schema can be assigned to another Schema, igmoring nullable.
- AssignContext() - Constructor for class org.apache.beam.sdk.transforms.windowing.WindowFn.AssignContext
-
- assignedWindows(WindowFn<T, W>, long) - Static method in class org.apache.beam.sdk.testing.WindowFnTestUtils
-
- assignedWindowsWithValue(WindowFn<T, W>, TimestampedValue<T>) - Static method in class org.apache.beam.sdk.testing.WindowFnTestUtils
-
- assignsToOneWindow() - Method in class org.apache.beam.sdk.transforms.windowing.GlobalWindows
-
- assignsToOneWindow() - Method in class org.apache.beam.sdk.transforms.windowing.PartitioningWindowFn
-
- assignsToOneWindow() - Method in class org.apache.beam.sdk.transforms.windowing.SlidingWindows
-
- assignsToOneWindow() - Method in class org.apache.beam.sdk.transforms.windowing.WindowFn
-
Returns true if this
WindowFn
always assigns an element to exactly one window.
- assignWindow(Instant) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.DaysWindows
-
- assignWindow(Instant) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.MonthsWindows
-
- assignWindow(Instant) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.YearsWindows
-
- assignWindow(Instant) - Method in class org.apache.beam.sdk.transforms.windowing.FixedWindows
-
- assignWindow(Instant) - Method in class org.apache.beam.sdk.transforms.windowing.PartitioningWindowFn
-
Returns the single window to which elements with this timestamp belong.
- assignWindows(WindowFn<Object, GlobalWindow>.AssignContext) - Method in class org.apache.beam.sdk.transforms.windowing.GlobalWindows
-
- assignWindows(WindowFn<Object, W>.AssignContext) - Method in class org.apache.beam.sdk.transforms.windowing.InvalidWindows
-
- assignWindows(WindowFn<T, W>.AssignContext) - Method in class org.apache.beam.sdk.transforms.windowing.PartitioningWindowFn
-
- assignWindows(WindowFn<Object, IntervalWindow>.AssignContext) - Method in class org.apache.beam.sdk.transforms.windowing.Sessions
-
- assignWindows(WindowFn<Object, IntervalWindow>.AssignContext) - Method in class org.apache.beam.sdk.transforms.windowing.SlidingWindows
-
- assignWindows(Instant) - Method in class org.apache.beam.sdk.transforms.windowing.SlidingWindows
-
- assignWindows(WindowFn<T, W>.AssignContext) - Method in class org.apache.beam.sdk.transforms.windowing.WindowFn
-
Given a timestamp and element, returns the set of windows into which it should be placed.
- asSingleton() - Static method in class org.apache.beam.sdk.transforms.View
-
- asSingletonView() - Method in class org.apache.beam.sdk.transforms.Combine.Globally
-
Returns a
PTransform
that produces a
PCollectionView
whose elements are the
result of combining elements per-window in the input
PCollection
.
- asV1Beta1Path() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubSubscription
-
- asV1Beta1Path() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubTopic
-
- asV1Beta2Path() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubSubscription
-
- asV1Beta2Path() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubIO.PubsubTopic
-
- atMinimumTimestamp(V) - Static method in class org.apache.beam.sdk.values.TimestampedValue
-
- AtomicCoder<T> - Class in org.apache.beam.sdk.coders
-
A
Coder
that has no component
Coders
or other configuration.
- AtomicCoder() - Constructor for class org.apache.beam.sdk.coders.AtomicCoder
-
- AtomicLongFactory() - Constructor for class org.apache.beam.sdk.options.PipelineOptions.AtomicLongFactory
-
- attached() - Method in class org.apache.beam.sdk.io.gcp.spanner.MutationGroup
-
- attachValues(List<Object>) - Method in class org.apache.beam.sdk.values.Row.Builder
-
- autoCastField(Schema.Field, Object) - Static method in class org.apache.beam.sdk.extensions.sql.impl.schema.BeamTableUtils
-
- AvailableParallelismFactory() - Constructor for class org.apache.beam.runners.direct.DirectOptions.AvailableParallelismFactory
-
- AvroCoder<T> - Class in org.apache.beam.sdk.coders
-
A
Coder
using Avro binary format.
- AvroCoder(Class<T>, Schema) - Constructor for class org.apache.beam.sdk.coders.AvroCoder
-
- AvroIO - Class in org.apache.beam.sdk.io
-
- AvroIO.Parse<T> - Class in org.apache.beam.sdk.io
-
- AvroIO.ParseAll<T> - Class in org.apache.beam.sdk.io
-
- AvroIO.Read<T> - Class in org.apache.beam.sdk.io
-
- AvroIO.ReadAll<T> - Class in org.apache.beam.sdk.io
-
- AvroIO.RecordFormatter<ElementT> - Interface in org.apache.beam.sdk.io
-
Formats an element of a user type into a record with the given schema.
- AvroIO.Sink<ElementT> - Class in org.apache.beam.sdk.io
-
- AvroIO.TypedWrite<UserT,DestinationT,OutputT> - Class in org.apache.beam.sdk.io
-
- AvroIO.Write<T> - Class in org.apache.beam.sdk.io
-
- AvroReader(AvroSource<T>) - Constructor for class org.apache.beam.sdk.io.AvroSource.AvroReader
-
Reads Avro records of type T
from the specified source.
- AvroSource<T> - Class in org.apache.beam.sdk.io
-
Do not use in pipelines directly: most users should use
AvroIO.Read
.
- AvroSource.AvroReader<T> - Class in org.apache.beam.sdk.io
-
- AvroUtils - Class in org.apache.beam.sdk.io.gcp.bigquery
-
Utils to help convert Apache Avro types to Beam types.
- AvroUtils() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.AvroUtils
-
- awaitCompletion() - Method in class org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver
-
- awaitCompletion() - Method in class org.apache.beam.sdk.fn.data.CompletableFutureInboundDataClient
-
- awaitCompletion() - Method in interface org.apache.beam.sdk.fn.data.InboundDataClient
-
Block until the client has completed reading from the inbound stream.
- awaitTermination(Duration) - Method in class org.apache.beam.runners.spark.SparkPipelineResult
-
- awaitTermination(Duration) - Method in class org.apache.beam.runners.spark.SparkRunnerDebugger.DebugSparkPipelineResult
-
- AwsClientsProvider - Interface in org.apache.beam.sdk.io.aws.sns
-
Provides instances of AWS clients.
- AWSClientsProvider - Interface in org.apache.beam.sdk.io.kinesis
-
Provides instances of AWS clients.
- AwsModule - Class in org.apache.beam.sdk.io.aws.options
-
- AwsModule() - Constructor for class org.apache.beam.sdk.io.aws.options.AwsModule
-
- AwsOptions - Interface in org.apache.beam.sdk.io.aws.options
-
Options used to configure Amazon Web Services specific options such as credentials and region.
- AwsOptions.AwsUserCredentialsFactory - Class in org.apache.beam.sdk.io.aws.options
-
Attempts to load AWS credentials.
- AwsOptions.ClientConfigurationFactory - Class in org.apache.beam.sdk.io.aws.options
-
Default AWS client configuration.
- AwsPipelineOptionsRegistrar - Class in org.apache.beam.sdk.io.aws.options
-
A registrar containing the default AWS options.
- AwsPipelineOptionsRegistrar() - Constructor for class org.apache.beam.sdk.io.aws.options.AwsPipelineOptionsRegistrar
-
- AwsUserCredentialsFactory() - Constructor for class org.apache.beam.sdk.io.aws.options.AwsOptions.AwsUserCredentialsFactory
-
- BACKLOG_UNKNOWN - Static variable in class org.apache.beam.sdk.io.UnboundedSource.UnboundedReader
-
Constant representing an unknown amount of backlog.
- backlogBytes() - Static method in class org.apache.beam.sdk.metrics.SourceMetrics
-
Gauge for source backlog in bytes.
- backlogBytesOfSplit(String) - Static method in class org.apache.beam.sdk.metrics.SourceMetrics
-
Gauge for source split backlog in bytes.
- backlogElements() - Static method in class org.apache.beam.sdk.metrics.SourceMetrics
-
Gauge for source backlog in elements.
- backlogElementsOfSplit(String) - Static method in class org.apache.beam.sdk.metrics.SourceMetrics
-
Gauge for source split backlog in elements.
- bag() - Static method in class org.apache.beam.sdk.state.StateSpecs
-
Create a
StateSpec
for a
BagState
, optimized for adding values frequently and
occasionally retrieving all the values that have been added.
- bag(Coder<T>) - Static method in class org.apache.beam.sdk.state.StateSpecs
-
- BagState<T> - Interface in org.apache.beam.sdk.state
-
- BagUserStateSpec() - Constructor for class org.apache.beam.runners.fnexecution.control.ProcessBundleDescriptors.BagUserStateSpec
-
- BaseBeamTable - Class in org.apache.beam.sdk.extensions.sql.impl.schema
-
Each IO in Beam has one table schema, by extending
BaseBeamTable
.
- BaseBeamTable(Schema) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable
-
- BatchStatefulParDoOverrides - Class in org.apache.beam.runners.dataflow
-
PTransformOverrideFactories
that expands to correctly implement
stateful
ParDo
using window-unaware
BatchViewOverrides.GroupByKeyAndSortValuesOnly
to linearize
processing per key.
- BatchStatefulParDoOverrides() - Constructor for class org.apache.beam.runners.dataflow.BatchStatefulParDoOverrides
-
- BatchStatefulParDoOverrides.BatchStatefulDoFn<K,V,OutputT> - Class in org.apache.beam.runners.dataflow
-
A key-preserving
DoFn
that explodes an iterable that has been grouped by key and
window.
- BEAM_FN_API_DATA_BUFFER_LIMIT - Static variable in class org.apache.beam.sdk.fn.data.BeamFnDataBufferingOutboundObserver
-
- BEAM_QUERYSTRING_PREFIX - Static variable in class org.apache.beam.sdk.extensions.sql.impl.JdbcDriver
-
Querystring parameters that begin with
"beam."
will be interpreted as
PipelineOptions
.
- BeamAggregationRel - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
- BeamAggregationRel(RelOptCluster, RelTraitSet, RelNode, boolean, ImmutableBitSet, List<ImmutableBitSet>, List<AggregateCall>, Optional<AggregateWindowField>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamAggregationRel
-
- BeamAggregationRule - Class in org.apache.beam.sdk.extensions.sql.impl.rule
-
Rule to detect the window/trigger settings.
- BeamAggregationRule(Class<? extends Aggregate>, Class<? extends Project>, RelBuilderFactory) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rule.BeamAggregationRule
-
- BeamAggregationTransforms - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
Collections of PTransform
and DoFn
used to perform GROUP-BY operation.
- BeamAggregationTransforms() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.transform.BeamAggregationTransforms
-
- BeamAggregationTransforms.AggregationAccumulator - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
A class to holder varied accumulator objects.
- BeamAggregationTransforms.AggregationAccumulatorCoder - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
- BeamAggregationTransforms.AggregationAdaptor - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
An adaptor class to invoke Calcite UDAF instances in Beam CombineFn
.
- BeamAggregationTransforms.AggregationGroupByKeyFn - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
extract group-by fields.
- BeamAggregationTransforms.MergeAggregationRecord - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
Merge KV to single record.
- BeamAggregationTransforms.WindowTimestampFn - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
Assign event timestamp.
- BeamBigQueryTable - Class in org.apache.beam.sdk.extensions.sql.meta.provider.bigquery
-
BeamBigQueryTable
represent a BigQuery table as a target.
- BeamBigQueryTable(Schema, String) - Constructor for class org.apache.beam.sdk.extensions.sql.meta.provider.bigquery.BeamBigQueryTable
-
- BeamCalciteSchema - Class in org.apache.beam.sdk.extensions.sql.impl
-
- BeamCalciteSchema(TableProvider) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.BeamCalciteSchema
-
- BeamCalciteSchemaFactory - Class in org.apache.beam.sdk.extensions.sql.impl
-
- BeamCalcRel - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
BeamRelNode to replace a Project
node.
- BeamCalcRel(RelOptCluster, RelTraitSet, RelNode, RexProgram) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamCalcRel
-
- BeamCalcRule - Class in org.apache.beam.sdk.extensions.sql.impl.rule
-
- BeamEnumerableConverter - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
BeamRelNode to replace a Enumerable
node.
- BeamEnumerableConverter(RelOptCluster, RelTraitSet, RelNode) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamEnumerableConverter
-
- BeamEnumerableConverterRule - Class in org.apache.beam.sdk.extensions.sql.impl.rule
-
A
ConverterRule
to Convert
BeamRelNode
to
EnumerableConvention
.
- BeamFileSystemArtifactRetrievalService - Class in org.apache.beam.runners.fnexecution.artifact
-
- BeamFileSystemArtifactRetrievalService() - Constructor for class org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
-
- BeamFileSystemArtifactStagingService - Class in org.apache.beam.runners.fnexecution.artifact
-
This implementation is experimental.
- BeamFileSystemArtifactStagingService() - Constructor for class org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
-
- BeamFnDataBufferingOutboundObserver<T> - Class in org.apache.beam.sdk.fn.data
-
- BeamFnDataGrpcMultiplexer - Class in org.apache.beam.sdk.fn.data
-
A gRPC multiplexer for a specific Endpoints.ApiServiceDescriptor
.
- BeamFnDataGrpcMultiplexer(Endpoints.ApiServiceDescriptor, OutboundObserverFactory, OutboundObserverFactory.BasicFactory<BeamFnApi.Elements, BeamFnApi.Elements>) - Constructor for class org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer
-
- BeamFnDataInboundObserver<T> - Class in org.apache.beam.sdk.fn.data
-
Decodes individually consumed
BeamFnApi.Elements.Data
with the provided
Coder
passing the individual decoded elements to the provided consumer.
- BeamFnDataInboundObserver(Coder<WindowedValue<T>>, FnDataReceiver<WindowedValue<T>>, InboundDataClient) - Constructor for class org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver
-
- BeamIntersectRel - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
BeamRelNode
to replace a Intersect
node.
- BeamIntersectRel(RelOptCluster, RelTraitSet, List<RelNode>, boolean) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamIntersectRel
-
- BeamIntersectRule - Class in org.apache.beam.sdk.extensions.sql.impl.rule
-
ConverterRule
to replace Intersect
with BeamIntersectRel
.
- BeamIOSinkRel - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
BeamRelNode to replace a TableModify
node.
- BeamIOSinkRel(RelOptCluster, RelOptTable, Prepare.CatalogReader, RelNode, TableModify.Operation, List<String>, List<RexNode>, boolean, BeamSqlTable, Map<String, String>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamIOSinkRel
-
- BeamIOSinkRule - Class in org.apache.beam.sdk.extensions.sql.impl.rule
-
- BeamIOSourceRel - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
BeamRelNode to replace a TableScan
node.
- BeamIOSourceRel(RelOptCluster, RelOptTable, BeamSqlTable, Map<String, String>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamIOSourceRel
-
- BeamJoinRel - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
BeamRelNode
to replace a Join
node.
- BeamJoinRel(RelOptCluster, RelTraitSet, RelNode, RelNode, RexNode, Set<CorrelationId>, JoinRelType) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel
-
- BeamJoinRule - Class in org.apache.beam.sdk.extensions.sql.impl.rule
-
ConverterRule
to replace Join
with BeamJoinRel
.
- BeamJoinTransforms - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
Collections of PTransform
and DoFn
used to perform JOIN operation.
- BeamJoinTransforms() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.transform.BeamJoinTransforms
-
- BeamJoinTransforms.ExtractJoinFields - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
A SimpleFunction
to extract join fields from the specified row.
- BeamJoinTransforms.JoinAsLookup - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
Transform to execute Join as Lookup.
- BeamJoinTransforms.JoinParts2WholeRow - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
A SimpleFunction
to combine two rows into one.
- BeamJoinTransforms.SideInputJoinDoFn - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
A DoFn
which implement the sideInput-JOIN.
- BeamKafkaCSVTable - Class in org.apache.beam.sdk.extensions.sql.meta.provider.kafka
-
A Kafka topic that saves records as CSV format.
- BeamKafkaCSVTable(Schema, String, List<String>) - Constructor for class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaCSVTable
-
- BeamKafkaCSVTable(Schema, String, List<String>, CSVFormat) - Constructor for class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaCSVTable
-
- BeamKafkaCSVTable.CsvRecorderDecoder - Class in org.apache.beam.sdk.extensions.sql.meta.provider.kafka
-
A PTransform to convert
KV<byte[], byte[]>
to
Row
.
- BeamKafkaCSVTable.CsvRecorderEncoder - Class in org.apache.beam.sdk.extensions.sql.meta.provider.kafka
-
A PTransform to convert
Row
to
KV<byte[], byte[]>
.
- BeamKafkaTable - Class in org.apache.beam.sdk.extensions.sql.meta.provider.kafka
-
BeamKafkaTable
represent a Kafka topic, as source or target.
- BeamKafkaTable(Schema) - Constructor for class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable
-
- BeamKafkaTable(Schema, String, List<String>) - Constructor for class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable
-
- BeamKafkaTable(Schema, List<TopicPartition>, String) - Constructor for class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable
-
- BeamLogicalConvention - Enum in org.apache.beam.sdk.extensions.sql.impl.rel
-
Convertion for Beam SQL.
- BeamMinusRel - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
BeamRelNode
to replace a Minus
node.
- BeamMinusRel(RelOptCluster, RelTraitSet, List<RelNode>, boolean) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamMinusRel
-
- BeamMinusRule - Class in org.apache.beam.sdk.extensions.sql.impl.rule
-
ConverterRule
to replace Minus
with BeamMinusRel
.
- BeamPCollectionTable<InputT> - Class in org.apache.beam.sdk.extensions.sql.impl.schema
-
BeamPCollectionTable
converts a PCollection<Row>
as a virtual table, then a
downstream query can query directly.
- BeamPCollectionTable(PCollection<InputT>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.schema.BeamPCollectionTable
-
- BeamRelDataTypeSystem - Class in org.apache.beam.sdk.extensions.sql.impl.planner
-
customized data type in Beam.
- BeamRelNode - Interface in org.apache.beam.sdk.extensions.sql.impl.rel
-
A
RelNode
that can also give a
PTransform
that implements the expression.
- beamRow2CsvLine(Row, CSVFormat) - Static method in class org.apache.beam.sdk.extensions.sql.impl.schema.BeamTableUtils
-
- BeamRuleSets - Class in org.apache.beam.sdk.extensions.sql.impl.planner
-
RuleSet
used in BeamQueryPlanner
.
- BeamRuleSets() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.planner.BeamRuleSets
-
- BeamSetOperatorRelBase - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
Delegate for Set operators: BeamUnionRel
, BeamIntersectRel
and BeamMinusRel
.
- BeamSetOperatorRelBase(BeamRelNode, BeamSetOperatorRelBase.OpType, boolean) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamSetOperatorRelBase
-
- BeamSetOperatorRelBase.OpType - Enum in org.apache.beam.sdk.extensions.sql.impl.rel
-
Set operator type.
- BeamSetOperatorsTransforms - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
Collections of PTransform
and DoFn
used to perform Set operations.
- BeamSetOperatorsTransforms() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.transform.BeamSetOperatorsTransforms
-
- BeamSetOperatorsTransforms.BeamSqlRow2KvFn - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
Transform a BeamSqlRow
to a KV<BeamSqlRow, BeamSqlRow>
.
- BeamSetOperatorsTransforms.SetOperatorFilteringDoFn - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
Filter function used for Set operators.
- BeamSortRel - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
BeamRelNode
to replace a Sort
node.
- BeamSortRel(RelOptCluster, RelTraitSet, RelNode, RelCollation, RexNode, RexNode) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamSortRel
-
- BeamSortRule - Class in org.apache.beam.sdk.extensions.sql.impl.rule
-
ConverterRule
to replace Sort
with BeamSortRel
.
- BeamSparkRunnerRegistrator - Class in org.apache.beam.runners.spark.coders
-
Custom KryoRegistrator
s for Beam's Spark runner needs.
- BeamSparkRunnerRegistrator() - Constructor for class org.apache.beam.runners.spark.coders.BeamSparkRunnerRegistrator
-
- BeamSqlAbsExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'ABS' function.
- BeamSqlAbsExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlAbsExpression
-
- BeamSqlAcosExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'ACOS' function.
- BeamSqlAcosExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlAcosExpression
-
- BeamSqlAndExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.logical
-
BeamSqlExpression
for 'AND' operation.
- BeamSqlAndExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.logical.BeamSqlAndExpression
-
- BeamSqlArithmeticExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic
-
Base class for all arithmetic operators.
- BeamSqlArithmeticExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlArithmeticExpression
-
- BeamSqlArithmeticExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlArithmeticExpression
-
- BeamSqlArrayExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.array
-
Represents ARRAY expression in SQL.
- BeamSqlArrayExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.array.BeamSqlArrayExpression
-
- BeamSqlArrayItemExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.array
-
Implements array element access expression.
- BeamSqlArrayItemExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.array.BeamSqlArrayItemExpression
-
- BeamSqlAsinExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'ASIN' function.
- BeamSqlAsinExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlAsinExpression
-
- BeamSqlAtan2Expression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
- BeamSqlAtan2Expression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlAtan2Expression
-
- BeamSqlAtanExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'ATAN' function.
- BeamSqlAtanExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlAtanExpression
-
- BeamSqlBinaryOperator - Interface in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
An operator that is applied to already-evaluated arguments.
- BeamSqlCardinalityExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.collection
-
Implements CARDINALITY(collection) operation which returns the number of elements in the
collection.
- BeamSqlCardinalityExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.collection.BeamSqlCardinalityExpression
-
- BeamSqlCaseExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
BeamSqlCaseExpression
represents CASE, NULLIF, COALESCE in SQL.
- BeamSqlCaseExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlCaseExpression
-
- BeamSqlCastExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
Base class to support 'CAST' operations for all SqlTypeName
.
- BeamSqlCastExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlCastExpression
-
- BeamSqlCeilExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'CEIL' function.
- BeamSqlCeilExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlCeilExpression
-
- BeamSqlCli - Class in org.apache.beam.sdk.extensions.sql
-
BeamSqlCli
provides methods to execute Beam SQL with an interactive client.
- BeamSqlCli() - Constructor for class org.apache.beam.sdk.extensions.sql.BeamSqlCli
-
- BeamSqlCompareExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison
-
- BeamSqlCompareExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlCompareExpression
-
- BeamSqlCorrelVariableExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
A primitive operation for dereferencing a correlation variable.
- BeamSqlCorrelVariableExpression(SqlTypeName, int) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlCorrelVariableExpression
-
- BeamSqlCosExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'COS' function.
- BeamSqlCosExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlCosExpression
-
- BeamSqlCotExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'COT' function.
- BeamSqlCotExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlCotExpression
-
- BeamSqlCurrentDateExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date
-
BeamSqlExpression
for CURRENT_DATE and LOCALTIME.
- BeamSqlCurrentDateExpression() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlCurrentDateExpression
-
- BeamSqlCurrentTimeExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date
-
BeamSqlExpression
for LOCALTIME and CURRENT_TIME.
- BeamSqlCurrentTimeExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlCurrentTimeExpression
-
- BeamSqlCurrentTimestampExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date
-
BeamSqlExpression
for LOCALTIMESTAMP and CURRENT_TIMESTAMP.
- BeamSqlCurrentTimestampExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlCurrentTimestampExpression
-
- BeamSqlDatetimeMinusExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date
-
Infix '-' operation for timestamps.
- BeamSqlDatetimeMinusExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlDatetimeMinusExpression
-
- BeamSqlDatetimeMinusIntervalExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date
-
minus ('-') operator for 'datetime - interval' expressions.
- BeamSqlDatetimeMinusIntervalExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlDatetimeMinusIntervalExpression
-
- BeamSqlDatetimePlusExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date
-
DATETIME_PLUS operation.
- BeamSqlDatetimePlusExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlDatetimePlusExpression
-
- BeamSqlDefaultExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
DEFAULT keyword for UDF with optional parameter.
- BeamSqlDefaultExpression() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlDefaultExpression
-
- BeamSqlDegreesExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'DEGREES' function.
- BeamSqlDegreesExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlDegreesExpression
-
- BeamSqlDivideExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic
-
'/' operator.
- BeamSqlDivideExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlDivideExpression
-
- BeamSqlDotExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
Implements DOT operator to access fields of dynamic ROWs.
- BeamSqlDotExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlDotExpression
-
- BeamSqlEnv - Class in org.apache.beam.sdk.extensions.sql.impl
-
Contains the metadata of tables/UDF functions, and exposes APIs to
query/validate/optimize/translate SQL statements.
- BeamSqlEqualsExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison
-
BeamSqlExpression
for =
operation.
- BeamSqlEqualsExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlEqualsExpression
-
- BeamSqlExpExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'EXP' function.
- BeamSqlExpExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlExpExpression
-
- BeamSqlExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
BeamSqlExpression
is an equivalent expression in BeamSQL, of RexNode
in Calcite.
- BeamSqlExpression() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlExpression
-
- BeamSqlExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlExpression
-
- BeamSqlExpressionEnvironment - Interface in org.apache.beam.sdk.extensions.sql.impl.interpreter
-
- BeamSqlExpressionEnvironments - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter
-
- BeamSqlExpressionEnvironments() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.BeamSqlExpressionEnvironments
-
- BeamSqlExpressionExecutor - Interface in org.apache.beam.sdk.extensions.sql.impl.interpreter
-
BeamSqlExpressionExecutor
fills the gap between relational expressions in Calcite SQL and
executable code.
- BeamSqlFieldAccessExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.row
-
Represents a field access expression.
- BeamSqlFieldAccessExpression(BeamSqlExpression, int, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.row.BeamSqlFieldAccessExpression
-
- BeamSqlFloorExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'FLOOR' function.
- BeamSqlFloorExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlFloorExpression
-
- BeamSqlFnExecutor - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter
-
- BeamSqlFnExecutor(RexProgram) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.BeamSqlFnExecutor
-
- BeamSqlGreaterThanExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison
-
BeamSqlExpression
for >
operation.
- BeamSqlGreaterThanExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlGreaterThanExpression
-
- BeamSqlGreaterThanOrEqualsExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison
-
BeamSqlExpression
for >=
operation.
- BeamSqlGreaterThanOrEqualsExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlGreaterThanOrEqualsExpression
-
- BeamSqlInputRefExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
A primitive operation for direct field extraction.
- BeamSqlInputRefExpression(SqlTypeName, int) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlInputRefExpression
-
- BeamSqlIntervalMultiplyExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date
-
Multiplication operator for intervals.
- BeamSqlIntervalMultiplyExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlIntervalMultiplyExpression
-
- BeamSqlIsNotNullExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison
-
BeamSqlExpression
for 'IS NOT NULL' operation.
- BeamSqlIsNotNullExpression(BeamSqlExpression) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlIsNotNullExpression
-
- BeamSqlIsNullExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison
-
BeamSqlExpression
for 'IS NULL' operation.
- BeamSqlIsNullExpression(BeamSqlExpression) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlIsNullExpression
-
- BeamSqlLessThanExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison
-
BeamSqlExpression
for <
operation.
- BeamSqlLessThanExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLessThanExpression
-
- BeamSqlLessThanOrEqualsExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison
-
BeamSqlExpression
for <=
operation.
- BeamSqlLessThanOrEqualsExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLessThanOrEqualsExpression
-
- BeamSqlLikeExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison
-
BeamSqlExpression
for 'LIKE' operation.
- BeamSqlLikeExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLikeExpression
-
- BeamSqlLnExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'LN' function.
- BeamSqlLnExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlLnExpression
-
- BeamSqlLocalRefExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
A primitive operation for dereferencing a correlation variable.
- BeamSqlLocalRefExpression(SqlTypeName, int) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlLocalRefExpression
-
- BeamSqlLogExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'Log10' function.
- BeamSqlLogExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlLogExpression
-
- BeamSqlLogicalExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.logical
-
BeamSqlExpression
for Logical operators.
- BeamSqlLogicalExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.logical.BeamSqlLogicalExpression
-
- BeamSqlMapExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.map
-
Represents MAP expression in SQL.
- BeamSqlMapExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.map.BeamSqlMapExpression
-
- BeamSqlMapItemExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.map
-
Implements map key access expression.
- BeamSqlMapItemExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.map.BeamSqlMapItemExpression
-
- BeamSqlMathBinaryExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
Base class for all binary functions such as POWER, MOD, RAND_INTEGER, ATAN2, ROUND, TRUNCATE.
- BeamSqlMathBinaryExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlMathBinaryExpression
-
- BeamSqlMathUnaryExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
Base class for all unary functions such as ABS, SQRT, LN, LOG10, EXP, CEIL, FLOOR, RAND, ACOS,
ASIN, ATAN, COS, COT, DEGREES, RADIANS, SIGN, SIN, TAN.
- BeamSqlMathUnaryExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlMathUnaryExpression
-
- BeamSqlMinusExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic
-
'-' operator.
- BeamSqlMinusExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlMinusExpression
-
- BeamSqlModExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic
-
'%' operator.
- BeamSqlModExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlModExpression
-
- BeamSqlMultiplyExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic
-
'*' operator.
- BeamSqlMultiplyExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlMultiplyExpression
-
- BeamSqlNotEqualsExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison
-
BeamSqlExpression
for <>
operation.
- BeamSqlNotEqualsExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlNotEqualsExpression
-
- BeamSqlNotExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.logical
-
BeamSqlExpression
for logical operator: NOT.
- BeamSqlNotExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.logical.BeamSqlNotExpression
-
- BeamSqlNotLikeExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison
-
BeamSqlNotLikeExpression
for <>
operation.
- BeamSqlNotLikeExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlNotLikeExpression
-
- BeamSqlOperator - Interface in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
An operator that is applied to already-evaluated arguments.
- BeamSqlOperatorExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
A generic expression form for an operator applied to arguments.
- BeamSqlOperatorExpression(BeamSqlOperator, List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlOperatorExpression
-
- BeamSqlOrExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.logical
-
BeamSqlExpression
for 'OR' operation.
- BeamSqlOrExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.logical.BeamSqlOrExpression
-
- BeamSqlOutputToConsoleFn - Class in org.apache.beam.sdk.extensions.sql.impl.transform
-
A test PTransform to display output in console.
- BeamSqlOutputToConsoleFn(String) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.transform.BeamSqlOutputToConsoleFn
-
- BeamSqlPiExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
Base class for the PI function.
- BeamSqlPiExpression() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlPiExpression
-
- BeamSqlPlusExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic
-
'+' operator.
- BeamSqlPlusExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlPlusExpression
-
- BeamSqlPowerExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathBinaryExpression
for 'POWER' function.
- BeamSqlPowerExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlPowerExpression
-
- BeamSqlPrimitive<T> - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
- BeamSqlRadiansExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'RADIANS' function.
- BeamSqlRadiansExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlRadiansExpression
-
- BeamSqlRandExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'RAND([seed])' function.
- BeamSqlRandExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlRandExpression
-
- BeamSqlRandIntegerExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'RAND_INTEGER([seed, ] numeric)' function.
- BeamSqlRandIntegerExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlRandIntegerExpression
-
- BeamSqlReinterpretExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret
-
BeamSqlExpression
for Reinterpret call.
- BeamSqlReinterpretExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret.BeamSqlReinterpretExpression
-
- BeamSqlRelUtils - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
Utilities for BeamRelNode
.
- BeamSqlRelUtils() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils
-
- BeamSqlRoundExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathBinaryExpression
for 'ROUND' function.
- BeamSqlRoundExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlRoundExpression
-
- BeamSqlRow2KvFn() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.transform.BeamSetOperatorsTransforms.BeamSqlRow2KvFn
-
- BeamSqlSeekableTable - Interface in org.apache.beam.sdk.extensions.sql
-
A seekable table converts a JOIN operator to an inline lookup.
- BeamSqlSignExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'SIGN' function.
- BeamSqlSignExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlSignExpression
-
- BeamSqlSinExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'SIN' function.
- BeamSqlSinExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlSinExpression
-
- BeamSqlSingleElementExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.collection
-
Implements ELEMENT(collection) operation which returns the single element from the collection.
- BeamSqlSingleElementExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.collection.BeamSqlSingleElementExpression
-
- BeamSqlTable - Interface in org.apache.beam.sdk.extensions.sql
-
This interface defines a Beam Sql Table.
- BeamSqlTanExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathUnaryExpression
for 'TAN' function.
- BeamSqlTanExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlTanExpression
-
- BeamSqlTimestampMinusIntervalExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date
-
'-' operator for 'timestamp - interval' expressions.
- BeamSqlTimestampMinusIntervalExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlTimestampMinusIntervalExpression
-
- BeamSqlTimestampMinusTimestampExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date
-
Infix '-' operation for timestamps.
- BeamSqlTimestampMinusTimestampExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.date.BeamSqlTimestampMinusTimestampExpression
-
- BeamSqlTruncateExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math
-
BeamSqlMathBinaryExpression
for 'TRUNCATE' function.
- BeamSqlTruncateExpression(List<BeamSqlExpression>) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlTruncateExpression
-
- BeamSqlUdf - Interface in org.apache.beam.sdk.extensions.sql
-
Interface to create a UDF in Beam SQL.
- BeamSqlUdfExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
invoke a UDF function.
- BeamSqlUdfExpression(Method, List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlUdfExpression
-
- BeamSqlUnaryOperator - Interface in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
An operator that is applied to already-evaluated arguments.
- BeamSqlWindowEndExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
BeamSqlExpression
for HOP_END
, TUMBLE_END
, SESSION_END
operation.
- BeamSqlWindowEndExpression() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlWindowEndExpression
-
- BeamSqlWindowExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
BeamSqlExpression
for HOP
, TUMBLE
, SESSION
operation.
- BeamSqlWindowExpression(List<BeamSqlExpression>, SqlTypeName) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlWindowExpression
-
- BeamSqlWindowStartExpression - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
BeamSqlExpression
for HOP_START
, TUMBLE_START
, SESSION_START
operation.
- BeamSqlWindowStartExpression() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.BeamSqlWindowStartExpression
-
- BeamTableUtils - Class in org.apache.beam.sdk.extensions.sql.impl.schema
-
Utility methods for working with BeamTable
.
- BeamTableUtils() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.schema.BeamTableUtils
-
- BeamUncollectRel - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
BeamRelNode
to implement an uncorrelated
Uncollect
, aka UNNEST.
- BeamUncollectRel(RelOptCluster, RelTraitSet, RelNode, boolean) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamUncollectRel
-
- BeamUncollectRule - Class in org.apache.beam.sdk.extensions.sql.impl.rule
-
- BeamUnionRel - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
- BeamUnionRel(RelOptCluster, RelTraitSet, List<RelNode>, boolean) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamUnionRel
-
- BeamUnionRule - Class in org.apache.beam.sdk.extensions.sql.impl.rule
-
- BeamUnnestRel - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
BeamRelNode
to implement UNNEST, supporting specifically only
Correlate
with
Uncollect
.
- BeamUnnestRel(RelOptCluster, RelTraitSet, RelNode, RelNode, CorrelationId, ImmutableBitSet, SemiJoinType) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamUnnestRel
-
- BeamUnnestRule - Class in org.apache.beam.sdk.extensions.sql.impl.rule
-
- BeamValuesRel - Class in org.apache.beam.sdk.extensions.sql.impl.rel
-
BeamRelNode
to replace a Values
node.
- BeamValuesRel(RelOptCluster, RelDataType, ImmutableList<ImmutableList<RexLiteral>>, RelTraitSet) - Constructor for class org.apache.beam.sdk.extensions.sql.impl.rel.BeamValuesRel
-
- BeamValuesRule - Class in org.apache.beam.sdk.extensions.sql.impl.rule
-
ConverterRule
to replace Values
with BeamValuesRel
.
- beforeStart(ClientCallStreamObserver<RespT>) - Method in class org.apache.beam.sdk.fn.stream.ForwardingClientResponseObserver
-
- begin() - Method in class org.apache.beam.sdk.Pipeline
-
Returns a
PBegin
owned by this Pipeline.
- beginningOnDay(int) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.MonthsWindows
-
- beginningOnDay(int, int) - Method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows.YearsWindows
-
- BIG_INT - Static variable in class org.apache.beam.sdk.extensions.sql.impl.utils.CalciteUtils
-
- BIG_QUERY_INSERT_ERROR_ERROR_CONTAINER - Static variable in interface org.apache.beam.sdk.io.gcp.bigquery.ErrorContainer
-
- BigDecimalCoder - Class in org.apache.beam.sdk.coders
-
- BigDecimalConverter - Class in org.apache.beam.sdk.extensions.sql.impl.utils
-
Provides converters from
BigDecimal
to other numeric types based on the input
Schema.TypeName
.
- BigDecimalConverter() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.utils.BigDecimalConverter
-
- bigdecimals() - Static method in class org.apache.beam.sdk.values.TypeDescriptors
-
- BigEndianIntegerCoder - Class in org.apache.beam.sdk.coders
-
- BigEndianLongCoder - Class in org.apache.beam.sdk.coders
-
- BigEndianShortCoder - Class in org.apache.beam.sdk.coders
-
- BigIntegerCoder - Class in org.apache.beam.sdk.coders
-
- bigintegers() - Static method in class org.apache.beam.sdk.values.TypeDescriptors
-
- BigQueryCoderProviderRegistrar - Class in org.apache.beam.sdk.io.gcp.bigquery
-
- BigQueryCoderProviderRegistrar() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.BigQueryCoderProviderRegistrar
-
- BigQueryHelpers - Class in org.apache.beam.sdk.io.gcp.bigquery
-
A set of helper functions and classes used by
BigQueryIO
.
- BigQueryHelpers() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers
-
- BigQueryInsertError - Class in org.apache.beam.sdk.io.gcp.bigquery
-
Model definition for BigQueryInsertError.
- BigQueryInsertError(TableRow, TableDataInsertAllResponse.InsertErrors, TableReference) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertError
-
- BigQueryInsertErrorCoder - Class in org.apache.beam.sdk.io.gcp.bigquery
-
- BigQueryInsertErrorCoder() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertErrorCoder
-
- BigQueryIO - Class in org.apache.beam.sdk.io.gcp.bigquery
-
- BigQueryIO.Read - Class in org.apache.beam.sdk.io.gcp.bigquery
-
- BigQueryIO.TypedRead<T> - Class in org.apache.beam.sdk.io.gcp.bigquery
-
- BigQueryIO.TypedRead.QueryPriority - Enum in org.apache.beam.sdk.io.gcp.bigquery
-
An enumeration type for the priority of a query.
- BigQueryIO.Write<T> - Class in org.apache.beam.sdk.io.gcp.bigquery
-
- BigQueryIO.Write.CreateDisposition - Enum in org.apache.beam.sdk.io.gcp.bigquery
-
An enumeration type for the BigQuery create disposition strings.
- BigQueryIO.Write.Method - Enum in org.apache.beam.sdk.io.gcp.bigquery
-
Determines the method used to insert data in BigQuery.
- BigQueryIO.Write.WriteDisposition - Enum in org.apache.beam.sdk.io.gcp.bigquery
-
An enumeration type for the BigQuery write disposition strings.
- BigQueryOptions - Interface in org.apache.beam.sdk.io.gcp.bigquery
-
Properties needed when using Google BigQuery with the Apache Beam SDK.
- BigQueryServices - Interface in org.apache.beam.sdk.io.gcp.bigquery
-
An interface for real, mock, or fake implementations of Cloud BigQuery services.
- BigQueryServices.DatasetService - Interface in org.apache.beam.sdk.io.gcp.bigquery
-
An interface to get, create and delete Cloud BigQuery datasets and tables.
- BigQueryServices.JobService - Interface in org.apache.beam.sdk.io.gcp.bigquery
-
An interface for the Cloud BigQuery load service.
- BigQueryTableProvider - Class in org.apache.beam.sdk.extensions.sql.meta.provider.bigquery
-
BigQuery table provider.
- BigQueryTableProvider() - Constructor for class org.apache.beam.sdk.extensions.sql.meta.provider.bigquery.BigQueryTableProvider
-
- BigQueryUtils - Class in org.apache.beam.sdk.io.gcp.bigquery
-
Utility methods for BigQuery related operations.
- BigQueryUtils() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.BigQueryUtils
-
- BigtableIO - Class in org.apache.beam.sdk.io.gcp.bigtable
-
Transforms
for reading from and writing to Google Cloud Bigtable.
- BigtableIO.Read - Class in org.apache.beam.sdk.io.gcp.bigtable
-
A
PTransform
that reads from Google Cloud Bigtable.
- BigtableIO.Write - Class in org.apache.beam.sdk.io.gcp.bigtable
-
A
PTransform
that writes to Google Cloud Bigtable.
- BinaryCombineDoubleFn() - Constructor for class org.apache.beam.sdk.transforms.Combine.BinaryCombineDoubleFn
-
- BinaryCombineFn() - Constructor for class org.apache.beam.sdk.transforms.Combine.BinaryCombineFn
-
- BinaryCombineIntegerFn() - Constructor for class org.apache.beam.sdk.transforms.Combine.BinaryCombineIntegerFn
-
- BinaryCombineLongFn() - Constructor for class org.apache.beam.sdk.transforms.Combine.BinaryCombineLongFn
-
- bind(String, StateBinder) - Method in interface org.apache.beam.sdk.state.StateSpec
-
For internal use only; no backwards-compatibility guarantees.
- bindBag(String, StateSpec<BagState<T>>, Coder<T>) - Method in interface org.apache.beam.sdk.state.StateBinder
-
- bindCombining(String, StateSpec<CombiningState<InputT, AccumT, OutputT>>, Coder<AccumT>, Combine.CombineFn<InputT, AccumT, OutputT>) - Method in interface org.apache.beam.sdk.state.StateBinder
-
- bindCombiningWithContext(String, StateSpec<CombiningState<InputT, AccumT, OutputT>>, Coder<AccumT>, CombineWithContext.CombineFnWithContext<InputT, AccumT, OutputT>) - Method in interface org.apache.beam.sdk.state.StateBinder
-
- bindMap(String, StateSpec<MapState<KeyT, ValueT>>, Coder<KeyT>, Coder<ValueT>) - Method in interface org.apache.beam.sdk.state.StateBinder
-
- bindSet(String, StateSpec<SetState<T>>, Coder<T>) - Method in interface org.apache.beam.sdk.state.StateBinder
-
- bindValue(String, StateSpec<ValueState<T>>, Coder<T>) - Method in interface org.apache.beam.sdk.state.StateBinder
-
- bindWatermark(String, StateSpec<WatermarkHoldState>, TimestampCombiner) - Method in interface org.apache.beam.sdk.state.StateBinder
-
- BitSetCoder - Class in org.apache.beam.sdk.coders
-
Coder for BitSet
.
- Block() - Constructor for class org.apache.beam.sdk.io.BlockBasedSource.Block
-
- BlockBasedReader(BlockBasedSource<T>) - Constructor for class org.apache.beam.sdk.io.BlockBasedSource.BlockBasedReader
-
- BlockBasedSource<T> - Class in org.apache.beam.sdk.io
-
A
BlockBasedSource
is a
FileBasedSource
where a file consists of blocks of
records.
- BlockBasedSource(String, EmptyMatchTreatment, long) - Constructor for class org.apache.beam.sdk.io.BlockBasedSource
-
Creates a BlockBasedSource
based on a file name or pattern.
- BlockBasedSource(String, long) - Constructor for class org.apache.beam.sdk.io.BlockBasedSource
-
- BlockBasedSource(ValueProvider<String>, long) - Constructor for class org.apache.beam.sdk.io.BlockBasedSource
-
- BlockBasedSource(ValueProvider<String>, EmptyMatchTreatment, long) - Constructor for class org.apache.beam.sdk.io.BlockBasedSource
-
- BlockBasedSource(MatchResult.Metadata, long, long, long) - Constructor for class org.apache.beam.sdk.io.BlockBasedSource
-
Creates a BlockBasedSource
for a single file.
- BlockBasedSource.Block<T> - Class in org.apache.beam.sdk.io
-
A Block
represents a block of records that can be read.
- BlockBasedSource.BlockBasedReader<T> - Class in org.apache.beam.sdk.io
-
- BlockingQueueIterator(BlockingQueue<T>) - Constructor for class org.apache.beam.sdk.fn.stream.DataStreams.BlockingQueueIterator
-
- BOOLEAN - Static variable in class org.apache.beam.sdk.extensions.sql.impl.utils.CalciteUtils
-
- BOOLEAN - Static variable in class org.apache.beam.sdk.schemas.Schema.FieldType
-
The type of boolean fields.
- BooleanCoder - Class in org.apache.beam.sdk.coders
-
- BooleanCoder() - Constructor for class org.apache.beam.sdk.coders.BooleanCoder
-
- booleans() - Static method in class org.apache.beam.sdk.values.TypeDescriptors
-
- Bounded(SparkContext, BoundedSource<T>, SerializablePipelineOptions, String) - Constructor for class org.apache.beam.runners.spark.io.SourceRDD.Bounded
-
- BoundedReader() - Constructor for class org.apache.beam.sdk.io.BoundedSource.BoundedReader
-
- BoundedReadFromUnboundedSource<T> - Class in org.apache.beam.sdk.io
-
PTransform
that reads a bounded amount of data from an
UnboundedSource
, specified
as one or both of a maximum number of elements or a maximum period of time to read.
- BoundedSource<T> - Class in org.apache.beam.sdk.io
-
A
Source
that reads a finite amount of input and, because of that, supports some
additional operations.
- BoundedSource() - Constructor for class org.apache.beam.sdk.io.BoundedSource
-
- BoundedSource.BoundedReader<T> - Class in org.apache.beam.sdk.io
-
A Reader
that reads a bounded amount of input and supports some additional operations,
such as progress estimation and dynamic work rebalancing.
- BoundedSourceWrapper<T> - Class in org.apache.beam.runners.gearpump.translators.io
-
wrapper over BoundedSource for Gearpump DataSource API.
- BoundedSourceWrapper(BoundedSource<T>, PipelineOptions) - Constructor for class org.apache.beam.runners.gearpump.translators.io.BoundedSourceWrapper
-
- BoundedWindow - Class in org.apache.beam.sdk.transforms.windowing
-
A
BoundedWindow
represents window information assigned to data elements.
- BoundedWindow() - Constructor for class org.apache.beam.sdk.transforms.windowing.BoundedWindow
-
- boundedWindowToGearpumpWindow(BoundedWindow) - Static method in class org.apache.beam.runners.gearpump.translators.utils.TranslatorUtils
-
- broadcast(JavaSparkContext) - Method in class org.apache.beam.runners.spark.util.SideInputBroadcast
-
- BufferedExternalSorter - Class in org.apache.beam.sdk.extensions.sorter
-
Sorter
that will use in memory sorting until the values can't fit into memory and will
then fall back to external sorting.
- BufferedExternalSorter.Options - Class in org.apache.beam.sdk.extensions.sorter
-
Contains configuration for the sorter.
- BufferingStreamObserver<T> - Class in org.apache.beam.sdk.fn.stream
-
A thread safe StreamObserver
which uses a bounded queue to pass elements to a processing
thread responsible for interacting with the underlying CallStreamObserver
.
- BufferingStreamObserver(Phaser, CallStreamObserver<T>, ExecutorService, int) - Constructor for class org.apache.beam.sdk.fn.stream.BufferingStreamObserver
-
- build() - Method in class org.apache.beam.runners.direct.WatermarkManager.TimerUpdate.TimerUpdateBuilder
-
- build() - Method in class org.apache.beam.sdk.extensions.gcp.storage.GcsCreateOptions.Builder
-
- build() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret.ReinterpretConversion.Builder
-
- build() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret.Reinterpreter.Builder
-
- build() - Method in class org.apache.beam.sdk.extensions.sql.meta.Table.Builder
-
- build() - Method in class org.apache.beam.sdk.fn.test.TestStreams.Builder
-
- build() - Method in class org.apache.beam.sdk.io.fs.CreateOptions.StandardCreateOptions.Builder
-
- build() - Method in class org.apache.beam.sdk.io.fs.MatchResult.Metadata.Builder
-
- build() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig.Builder
-
- build() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction.Builder
-
- build() - Method in class org.apache.beam.sdk.metrics.MetricsFilter.Builder
-
- build() - Method in class org.apache.beam.sdk.schemas.Schema.Builder
-
- build() - Method in class org.apache.beam.sdk.values.Row.Builder
-
- buildBeamSqlTable(Table) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.bigquery.BigQueryTableProvider
-
- buildBeamSqlTable(Table) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.KafkaTableProvider
-
- buildBeamSqlTable(Table) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.pubsub.PubsubJsonTableProvider
-
- buildBeamSqlTable(Table) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.ReadOnlyTableProvider
-
- buildBeamSqlTable(Table) - Method in interface org.apache.beam.sdk.extensions.sql.meta.provider.TableProvider
-
- buildBeamSqlTable(Table) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.test.TestTableProvider
-
- buildBeamSqlTable(Table) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.text.TextTableProvider
-
- buildBeamSqlTable(Table) - Method in class org.apache.beam.sdk.extensions.sql.meta.store.InMemoryMetaStore
-
- builder(StructuralKey<?>) - Static method in class org.apache.beam.runners.direct.WatermarkManager.TimerUpdate
-
Creates a new
WatermarkManager.TimerUpdate
builder with the provided completed timers that needs the
set and deleted timers to be added to it.
- builder() - Static method in class org.apache.beam.runners.fnexecution.jobsubmission.JobPreparation
-
- builder() - Static method in class org.apache.beam.sdk.extensions.gcp.storage.GcsCreateOptions
-
- Builder() - Constructor for class org.apache.beam.sdk.extensions.gcp.storage.GcsCreateOptions.Builder
-
- builder() - Static method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret.ReinterpretConversion
-
- Builder() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret.ReinterpretConversion.Builder
-
- builder() - Static method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret.Reinterpreter
-
- Builder() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret.Reinterpreter.Builder
-
- builder() - Static method in class org.apache.beam.sdk.extensions.sql.meta.provider.pubsub.PubsubMessageToRow
-
- builder() - Static method in class org.apache.beam.sdk.extensions.sql.meta.Table
-
- Builder() - Constructor for class org.apache.beam.sdk.extensions.sql.meta.Table.Builder
-
- Builder() - Constructor for class org.apache.beam.sdk.io.fs.CreateOptions.Builder
-
- builder() - Static method in class org.apache.beam.sdk.io.fs.CreateOptions.StandardCreateOptions
-
- Builder() - Constructor for class org.apache.beam.sdk.io.fs.CreateOptions.StandardCreateOptions.Builder
-
- builder() - Static method in class org.apache.beam.sdk.io.fs.MatchResult.Metadata
-
- Builder() - Constructor for class org.apache.beam.sdk.io.fs.MatchResult.Metadata.Builder
-
- Builder() - Constructor for class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig.Builder
-
- Builder() - Constructor for class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction.Builder
-
- builder() - Static method in class org.apache.beam.sdk.metrics.MetricsFilter
-
- Builder() - Constructor for class org.apache.beam.sdk.metrics.MetricsFilter.Builder
-
- builder() - Static method in class org.apache.beam.sdk.schemas.Schema
-
- Builder() - Constructor for class org.apache.beam.sdk.schemas.Schema.Builder
-
- builderFor(Endpoints.ApiServiceDescriptor) - Method in class org.apache.beam.sdk.fn.channel.ManagedChannelFactory
-
Create a ManagedChannelBuilder
for the provided Endpoints.ApiServiceDescriptor
.
- builderFor(Endpoints.ApiServiceDescriptor) - Method in class org.apache.beam.sdk.fn.test.InProcessManagedChannelFactory
-
- buildIOReader(PBegin) - Method in interface org.apache.beam.sdk.extensions.sql.BeamSqlTable
-
create a PCollection<Row>
from source.
- buildIOReader(PBegin) - Method in class org.apache.beam.sdk.extensions.sql.impl.schema.BeamPCollectionTable
-
- buildIOReader(PBegin) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.bigquery.BeamBigQueryTable
-
- buildIOReader(PBegin) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable
-
- buildIOReader(PBegin) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.text.TextTable
-
- buildIOWriter(PCollection<Row>) - Method in interface org.apache.beam.sdk.extensions.sql.BeamSqlTable
-
create a IO.write()
instance to write to target.
- buildIOWriter(PCollection<Row>) - Method in class org.apache.beam.sdk.extensions.sql.impl.schema.BeamPCollectionTable
-
- buildIOWriter(PCollection<Row>) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.bigquery.BeamBigQueryTable
-
- buildIOWriter(PCollection<Row>) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaTable
-
- buildIOWriter(PCollection<Row>) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.text.TextTable
-
- buildPTransform() - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamAggregationRel
-
- buildPTransform() - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamCalcRel
-
- buildPTransform() - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamIntersectRel
-
- buildPTransform() - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamIOSinkRel
-
- buildPTransform() - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamIOSourceRel
-
- buildPTransform() - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel
-
- buildPTransform() - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamMinusRel
-
- buildPTransform() - Method in interface org.apache.beam.sdk.extensions.sql.impl.rel.BeamRelNode
-
- buildPTransform() - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamSortRel
-
- buildPTransform() - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamUncollectRel
-
- buildPTransform() - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamUnionRel
-
- buildPTransform() - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamUnnestRel
-
- buildPTransform() - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamValuesRel
-
- buildTemporaryFilename(ResourceId, String) - Static method in class org.apache.beam.sdk.io.FileBasedSink.WriteOperation
-
Constructs a temporary file resource given the temporary directory and a filename.
- Bundle<T,CollectionT> - Interface in org.apache.beam.runners.local
-
An immutable collection of elements which are part of a PCollection
.
- BundleProgressHandler - Interface in org.apache.beam.runners.fnexecution.control
-
A handler for bundle progress messages, both during bundle execution and on its completion.
- by(SerializableFunction<UserT, DestinationT>) - Method in class org.apache.beam.sdk.io.FileIO.Write
-
Specifies how to partition elements into groups ("destinations").
- by(Contextful<Contextful.Fn<UserT, DestinationT>>) - Method in class org.apache.beam.sdk.io.FileIO.Write
-
- by(PredicateT) - Static method in class org.apache.beam.sdk.transforms.Filter
-
Returns a PTransform
that takes an input PCollection<T>
and returns a PCollection<T>
with elements that satisfy the given predicate.
- BYTE - Static variable in class org.apache.beam.sdk.schemas.Schema.FieldType
-
The type of byte fields.
- ByteArray - Class in org.apache.beam.runners.spark.util
-
Serializable byte array.
- ByteArray(byte[]) - Constructor for class org.apache.beam.runners.spark.util.ByteArray
-
- ByteArrayCoder - Class in org.apache.beam.sdk.coders
-
- ByteCoder - Class in org.apache.beam.sdk.coders
-
A
ByteCoder
encodes
Byte
values in 1 byte using Java serialization.
- ByteKey - Class in org.apache.beam.sdk.io.range
-
A class representing a key consisting of an array of bytes.
- ByteKeyRange - Class in org.apache.beam.sdk.io.range
-
A class representing a range of
ByteKeys
.
- ByteKeyRangeTracker - Class in org.apache.beam.sdk.io.range
-
- ByteKeyRangeTracker - Class in org.apache.beam.sdk.transforms.splittabledofn
-
- BYTES - Static variable in class org.apache.beam.sdk.schemas.Schema.FieldType
-
The type of bytes fields.
- bytes() - Static method in class org.apache.beam.sdk.values.TypeDescriptors
-
- bytesRead() - Static method in class org.apache.beam.sdk.metrics.SourceMetrics
-
Counter of bytes read by a source.
- bytesReadBySplit(String) - Static method in class org.apache.beam.sdk.metrics.SourceMetrics
-
Counter of bytes read by a source split.
- ByteStringCoder - Class in org.apache.beam.sdk.extensions.protobuf
-
A
Coder
for
ByteString
objects based on their encoded Protocol Buffer form.
- bytesWritten() - Static method in class org.apache.beam.sdk.metrics.SinkMetrics
-
Counter of bytes written to a sink.
- CACHED_GETTERS - Static variable in class org.apache.beam.sdk.schemas.utils.POJOUtils
-
- calc(BigDecimal, BigDecimal) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlArithmeticExpression
-
- calc(BigDecimal, BigDecimal) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlDivideExpression
-
- calc(BigDecimal, BigDecimal) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlMinusExpression
-
- calc(BigDecimal, BigDecimal) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlModExpression
-
- calc(BigDecimal, BigDecimal) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlMultiplyExpression
-
- calc(BigDecimal, BigDecimal) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlPlusExpression
-
- CalciteUtils - Class in org.apache.beam.sdk.extensions.sql.impl.utils
-
Utility methods for Calcite related operations.
- CalciteUtils() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.utils.CalciteUtils
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlAbsExpression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlAcosExpression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlAsinExpression
-
- calculate(BeamSqlPrimitive, BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlAtan2Expression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlAtanExpression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlCeilExpression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlCosExpression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlCotExpression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlDegreesExpression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlExpExpression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlFloorExpression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlLnExpression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlLogExpression
-
- calculate(BeamSqlPrimitive, BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlMathBinaryExpression
-
The base method for implementation of math binary functions.
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlMathUnaryExpression
-
For the operands of other type SqlTypeName.NUMERIC_TYPES
.
- calculate(BeamSqlPrimitive, BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlPowerExpression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlRadiansExpression
-
- calculate(BeamSqlPrimitive, BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlRoundExpression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlSignExpression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlSinExpression
-
- calculate(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlTanExpression
-
- calculate(BeamSqlPrimitive, BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.math.BeamSqlTruncateExpression
-
- CalendarWindows - Class in org.apache.beam.sdk.transforms.windowing
-
A collection of
WindowFn
s that windows values into calendar-based windows such as spans
of days, months, or years.
- CalendarWindows() - Constructor for class org.apache.beam.sdk.transforms.windowing.CalendarWindows
-
- CalendarWindows.DaysWindows - Class in org.apache.beam.sdk.transforms.windowing
-
A
WindowFn
that windows elements into periods measured by days.
- CalendarWindows.MonthsWindows - Class in org.apache.beam.sdk.transforms.windowing
-
A
WindowFn
that windows elements into periods measured by months.
- CalendarWindows.YearsWindows - Class in org.apache.beam.sdk.transforms.windowing
-
A
WindowFn
that windows elements into periods measured by years.
- cancel() - Method in class org.apache.beam.runners.apex.ApexRunnerResult
-
- cancel() - Method in class org.apache.beam.runners.dataflow.DataflowPipelineJob
-
- cancel() - Method in class org.apache.beam.runners.dataflow.util.DataflowTemplateJob
-
- cancel() - Method in class org.apache.beam.runners.direct.DirectRunner.DirectPipelineResult
-
- cancel(JobApi.CancelJobRequest, StreamObserver<JobApi.CancelJobResponse>) - Method in class org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService
-
- cancel() - Method in class org.apache.beam.runners.flink.FlinkDetachedRunnerResult
-
- cancel() - Method in class org.apache.beam.runners.flink.FlinkJobInvocation
-
- cancel() - Method in class org.apache.beam.runners.flink.FlinkRunnerResult
-
- cancel(JobApi.CancelJobRequest, StreamObserver<JobApi.CancelJobResponse>) - Method in class org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService
-
- cancel() - Method in interface org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation
-
Cancel the job.
- cancel() - Method in class org.apache.beam.runners.gearpump.GearpumpPipelineResult
-
- cancel() - Method in class org.apache.beam.runners.spark.SparkPipelineResult
-
- cancel() - Method in class org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver
-
- cancel() - Method in class org.apache.beam.sdk.fn.data.CompletableFutureInboundDataClient
-
- cancel() - Method in interface org.apache.beam.sdk.fn.data.InboundDataClient
-
Cancels the client, causing it to drop any future inbound data.
- cancel() - Method in interface org.apache.beam.sdk.PipelineResult
-
Cancels the pipeline execution.
- cancelled() - Method in interface org.apache.beam.runners.local.PipelineMessageReceiver
-
Report that the pipeline has been cancelled.
- canConvert(SqlTypeName, SqlTypeName) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret.Reinterpreter
-
- canConvertConvention(Convention) - Method in enum org.apache.beam.sdk.extensions.sql.impl.rel.BeamLogicalConvention
-
- CannotProvideCoderException - Exception in org.apache.beam.sdk.coders
-
- CannotProvideCoderException(String) - Constructor for exception org.apache.beam.sdk.coders.CannotProvideCoderException
-
- CannotProvideCoderException(String, CannotProvideCoderException.ReasonCode) - Constructor for exception org.apache.beam.sdk.coders.CannotProvideCoderException
-
- CannotProvideCoderException(String, Throwable) - Constructor for exception org.apache.beam.sdk.coders.CannotProvideCoderException
-
- CannotProvideCoderException(String, Throwable, CannotProvideCoderException.ReasonCode) - Constructor for exception org.apache.beam.sdk.coders.CannotProvideCoderException
-
- CannotProvideCoderException(Throwable) - Constructor for exception org.apache.beam.sdk.coders.CannotProvideCoderException
-
- CannotProvideCoderException(Throwable, CannotProvideCoderException.ReasonCode) - Constructor for exception org.apache.beam.sdk.coders.CannotProvideCoderException
-
- CannotProvideCoderException.ReasonCode - Enum in org.apache.beam.sdk.coders
-
Indicates the reason that
Coder
inference failed.
- canStopPolling(Instant, StateT) - Method in interface org.apache.beam.sdk.transforms.Watch.Growth.TerminationCondition
-
- CassandraIO - Class in org.apache.beam.sdk.io.cassandra
-
An IO to read from Apache Cassandra.
- CassandraIO.Read<T> - Class in org.apache.beam.sdk.io.cassandra
-
- CassandraIO.Write<T> - Class in org.apache.beam.sdk.io.cassandra
-
- CassandraService<T> - Interface in org.apache.beam.sdk.io.cassandra
-
An interface for real or fake implementations of Cassandra.
- CassandraService.Writer<T> - Interface in org.apache.beam.sdk.io.cassandra
-
Writer for an entity.
- CassandraServiceImpl<T> - Class in org.apache.beam.sdk.io.cassandra
-
An implementation of the
CassandraService
that actually use a Cassandra instance.
- CassandraServiceImpl() - Constructor for class org.apache.beam.sdk.io.cassandra.CassandraServiceImpl
-
- CassandraServiceImpl.WriterImpl - Class in org.apache.beam.sdk.io.cassandra
-
Writer storing an entity into Apache Cassandra database.
- CHAR - Static variable in class org.apache.beam.sdk.extensions.sql.impl.utils.CalciteUtils
-
- CHAR_LENGTH - Static variable in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.StringOperators
-
- characters() - Static method in class org.apache.beam.sdk.values.TypeDescriptors
-
- checkDone() - Method in class org.apache.beam.sdk.transforms.splittabledofn.ByteKeyRangeTracker
-
- checkDone() - Method in class org.apache.beam.sdk.transforms.splittabledofn.OffsetRangeTracker
-
- checkDone() - Method in class org.apache.beam.sdk.transforms.splittabledofn.RestrictionTracker
-
Called by the runner after DoFn.ProcessElement
returns.
- checkIfAnySubscriptionExists(String, Duration) - Method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsub
-
Check if topics exist.
- checkpoint() - Method in class org.apache.beam.sdk.transforms.splittabledofn.ByteKeyRangeTracker
-
- checkpoint() - Method in class org.apache.beam.sdk.transforms.splittabledofn.OffsetRangeTracker
-
- checkpoint() - Method in class org.apache.beam.sdk.transforms.splittabledofn.RestrictionTracker
-
Signals that the current
DoFn.ProcessElement
call should terminate as soon as possible:
after this method returns, the tracker MUST refuse all future claim calls, and
RestrictionTracker.checkDone()
MUST succeed.
- classesToTranslators() - Method in interface org.apache.beam.runners.dataflow.util.CoderCloudObjectTranslatorRegistrar
-
- classesToTranslators() - Method in class org.apache.beam.runners.dataflow.util.DefaultCoderCloudObjectTranslatorRegistrar
-
- classNamesToTranslators() - Method in interface org.apache.beam.runners.dataflow.util.CoderCloudObjectTranslatorRegistrar
-
- classNamesToTranslators() - Method in class org.apache.beam.runners.dataflow.util.DefaultCoderCloudObjectTranslatorRegistrar
-
- CLASSPATH_SCHEME - Static variable in class org.apache.beam.runners.apex.ApexRunner
-
- cleanup() - Method in class org.apache.beam.sdk.io.FileBasedSink.Writer
-
- cleanupOnCancelOrFinish() - Method in class org.apache.beam.runners.apex.ApexRunnerResult
-
Opportunity for a subclass to perform cleanup, such as removing temporary files.
- clear(K, W) - Method in interface org.apache.beam.runners.fnexecution.state.StateRequestHandlers.BagUserStateHandler
-
Clears the bag user state for the given key and window.
- clear() - Static method in class org.apache.beam.runners.spark.aggregators.AggregatorsAccumulator
-
- clear() - Static method in class org.apache.beam.runners.spark.metrics.MetricsAccumulator
-
- clear() - Static method in class org.apache.beam.runners.spark.util.GlobalWatermarkHolder
-
- clear() - Method in interface org.apache.beam.sdk.state.State
-
Clear out the state location.
- clearCache() - Static method in class org.apache.beam.runners.spark.io.MicrobatchSource
-
- clearOutputElements() - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
- clearOutputElements(TupleTag<T>) - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
- clientBuffered(ExecutorService) - Static method in class org.apache.beam.sdk.fn.stream.OutboundObserverFactory
-
Create a buffering
OutboundObserverFactory
for client-side RPCs with the specified
ExecutorService
and the default buffer size.
- clientBuffered(ExecutorService, int) - Static method in class org.apache.beam.sdk.fn.stream.OutboundObserverFactory
-
Create a buffering
OutboundObserverFactory
for client-side RPCs with the specified
ExecutorService
and buffer size.
- ClientConfigurationFactory() - Constructor for class org.apache.beam.sdk.io.aws.options.AwsOptions.ClientConfigurationFactory
-
- clientDirect() - Static method in class org.apache.beam.sdk.fn.stream.OutboundObserverFactory
-
Create the default
OutboundObserverFactory
for client-side RPCs, which uses basic
unbuffered flow control and adds synchronization to provide thread safety of access to the
returned observer.
- Clock - Interface in org.apache.beam.runners.direct
-
Access to the current time.
- clone() - Method in class org.apache.beam.runners.dataflow.util.CloudObject
-
- clone() - Method in class org.apache.beam.runners.flink.metrics.MetricsAccumulator
-
- clonesOf(OutT) - Static method in class org.apache.beam.sdk.transforms.SerializableFunctions
-
- close() - Method in class org.apache.beam.runners.direct.portable.artifact.LocalFileSystemArtifactRetrievalService
-
- close() - Method in class org.apache.beam.runners.direct.portable.artifact.LocalFileSystemArtifactStagerService
-
- close() - Method in class org.apache.beam.runners.direct.portable.artifact.UnsupportedArtifactRetrievalService
-
- close() - Method in class org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService
-
- close() - Method in class org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
-
- close() - Method in class org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
-
- close() - Method in class org.apache.beam.runners.fnexecution.control.DockerJobBundleFactory
-
- close() - Method in class org.apache.beam.runners.fnexecution.control.FnApiControlClient
-
- close() - Method in class org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
-
- close() - Method in interface org.apache.beam.runners.fnexecution.control.RemoteBundle
-
Closes this bundle.
- close() - Method in class org.apache.beam.runners.fnexecution.control.SdkHarnessClient.ActiveBundle
-
Blocks till bundle processing is finished.
- close() - Method in class org.apache.beam.runners.fnexecution.control.SdkHarnessClient
-
- close() - Method in class org.apache.beam.runners.fnexecution.control.SingleEnvironmentInstanceJobBundleFactory
-
Deprecated.
- close() - Method in class org.apache.beam.runners.fnexecution.data.GrpcDataService
-
- close() - Method in interface org.apache.beam.runners.fnexecution.environment.RemoteEnvironment
-
.
- close() - Method in interface org.apache.beam.runners.fnexecution.FnService
-
.
- close() - Method in class org.apache.beam.runners.fnexecution.GrpcFnServer
-
- close() - Method in class org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService
-
- close() - Method in class org.apache.beam.runners.fnexecution.logging.GrpcLoggingService
-
- close() - Method in class org.apache.beam.runners.fnexecution.provisioning.StaticGrpcProvisionService
-
- close() - Method in class org.apache.beam.runners.fnexecution.state.GrpcStateService
-
- close() - Method in class org.apache.beam.runners.gearpump.translators.io.GearpumpSource
-
- close() - Method in class org.apache.beam.runners.reference.CloseableResource
-
Closes the underlying resource.
- close(T) - Method in interface org.apache.beam.runners.reference.CloseableResource.Closer
-
- close() - Method in class org.apache.beam.runners.spark.io.MicrobatchSource.Reader
-
- close() - Method in interface org.apache.beam.sdk.extensions.sql.impl.interpreter.BeamSqlExpressionExecutor
-
- close() - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.BeamSqlFnExecutor
-
- close() - Method in class org.apache.beam.sdk.fn.data.BeamFnDataBufferingOutboundObserver
-
- close() - Method in class org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer
-
- close() - Method in interface org.apache.beam.sdk.fn.data.CloseableFnDataReceiver
-
.
- close() - Method in class org.apache.beam.sdk.fn.stream.DataStreams.BlockingQueueIterator
-
- close() - Method in class org.apache.beam.sdk.fn.stream.DataStreams.ElementDelimitedOutputStream
-
- close() - Method in class org.apache.beam.sdk.io.cassandra.CassandraServiceImpl.WriterImpl
-
- close() - Method in class org.apache.beam.sdk.io.FileBasedSink.Writer
-
Closes the channel and returns the bundle result.
- close() - Method in class org.apache.beam.sdk.io.FileBasedSource.FileBasedReader
-
Closes any ReadableByteChannel
created for the current reader.
- close() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient
-
Gracefully close the underlying netty channel.
- close() - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient
-
- close() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerAccessor
-
- close() - Method in class org.apache.beam.sdk.io.kafka.serialization.InstantDeserializer
-
- close() - Method in class org.apache.beam.sdk.io.kafka.serialization.InstantSerializer
-
- close() - Method in class org.apache.beam.sdk.io.Source.Reader
-
Closes the reader.
- close() - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
- CloseableFnDataReceiver<T> - Interface in org.apache.beam.sdk.fn.data
-
A receiver of streamed data that can be closed.
- CloseableResource<T> - Class in org.apache.beam.runners.reference
-
An AutoCloseable
that wraps a resource that needs to be cleaned up but does not implement
AutoCloseable
itself.
- CloseableResource.CloseException - Exception in org.apache.beam.runners.reference
-
An exception that wraps errors thrown while a resource is being closed.
- CloseableResource.Closer<T> - Interface in org.apache.beam.runners.reference
-
A function that knows how to clean up after a resource.
- CloseableThrowingConsumer<T> - Interface in org.apache.beam.sdk.fn.function
-
- CloudDebuggerOptions - Interface in org.apache.beam.runners.dataflow.options
-
Options for controlling Cloud Debugger.
- CloudObject - Class in org.apache.beam.runners.dataflow.util
-
A representation of an arbitrary Java object to be instantiated by Dataflow workers.
- cloudObjectClassName() - Method in interface org.apache.beam.runners.dataflow.util.CloudObjectTranslator
-
- CloudObjects - Class in org.apache.beam.runners.dataflow.util
-
- CloudObjectTranslator<T> - Interface in org.apache.beam.runners.dataflow.util
-
A translator that takes an object and creates a
CloudObject
which can be converted back
to the original object.
- CloudResourceManagerOptions - Interface in org.apache.beam.sdk.extensions.gcp.options
-
Properties needed when using Google CloudResourceManager with the Apache Beam SDK.
- CO_GBK_RESULT_SCHEMA - Static variable in class org.apache.beam.runners.dataflow.util.PropertyNames
-
- Coder<T> - Class in org.apache.beam.sdk.coders
-
A
Coder<T>
defines how to encode and decode values of type
T
into
byte streams.
- Coder() - Constructor for class org.apache.beam.sdk.coders.Coder
-
- Coder.Context - Class in org.apache.beam.sdk.coders
-
- Coder.NonDeterministicException - Exception in org.apache.beam.sdk.coders
-
Exception thrown by
Coder.verifyDeterministic()
if the encoding is not deterministic,
including details of why the encoding is not deterministic.
- CoderCloudObjectTranslatorRegistrar - Interface in org.apache.beam.runners.dataflow.util
-
Coder
authors have the ability to automatically have their
Coder
registered with
the Dataflow Runner by creating a
ServiceLoader
entry and a concrete implementation of
this interface.
- coderConsistentWithEquals(Coder<T>, T, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<T>
and values of type T
, the values are equal
if and only if the encoded bytes are equal.
- coderConsistentWithEqualsInContext(Coder<T>, Coder.Context, T, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<T>
, Coder.Context
, and values of type T
, the values are equal if and only if the encoded bytes are equal, in any Coder.Context
.
- coderDecodeEncodeContentsEqual(Coder<CollectionT>, CollectionT) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<Collection<T>>
, and value of type Collection<T>
, encoding followed by decoding yields an equal value of type Collection<T>
, in any Coder.Context
.
- coderDecodeEncodeContentsEqualInContext(Coder<CollectionT>, Coder.Context, CollectionT) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<Collection<T>>
, and value of type Collection<T>
, encoding followed by decoding yields an equal value of type Collection<T>
, in the given Coder.Context
.
- coderDecodeEncodeContentsInSameOrder(Coder<IterableT>, IterableT) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<Collection<T>>
, and value of type Collection<T>
, encoding followed by decoding yields an equal value of type Collection<T>
, in any Coder.Context
.
- coderDecodeEncodeContentsInSameOrderInContext(Coder<IterableT>, Coder.Context, IterableT) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<Iterable<T>>
, and value of type Iterable<T>
,
encoding followed by decoding yields an equal value of type Collection<T>
, in the given
Coder.Context
.
- coderDecodeEncodeEqual(Coder<T>, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<T>
, and value of type T
, encoding followed by
decoding yields an equal value of type T
, in any Coder.Context
.
- coderDecodeEncodeEqualInContext(Coder<T>, Coder.Context, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<T>
, Coder.Context
, and value of type T
, encoding followed by decoding yields an equal value of type T
.
- coderDecodesBase64(Coder<T>, String, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- coderDecodesBase64(Coder<T>, List<String>, List<T>) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- coderDecodesBase64ContentsEqual(Coder<IterableT>, String, IterableT) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- coderDecodesBase64ContentsEqual(Coder<IterableT>, List<String>, List<IterableT>) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- coderDeterministic(Coder<T>, T, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<T>
, and values of type T
, if the values are
equal then the encoded bytes are equal, in any Coder.Context
.
- coderDeterministicInContext(Coder<T>, Coder.Context, T, T) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that for the given Coder<T>
, Coder.Context
, and values of type T
, if the values are equal then the encoded bytes are equal.
- coderEncodesBase64(Coder<T>, T, String) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- coderEncodesBase64(Coder<T>, List<T>, List<String>) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
- CoderException - Exception in org.apache.beam.sdk.coders
-
An Exception
thrown if there is a problem encoding or decoding a value.
- CoderException(String) - Constructor for exception org.apache.beam.sdk.coders.CoderException
-
- CoderException(String, Throwable) - Constructor for exception org.apache.beam.sdk.coders.CoderException
-
- CoderException(Throwable) - Constructor for exception org.apache.beam.sdk.coders.CoderException
-
- coderFor(TypeDescriptor<T>, List<? extends Coder<?>>) - Method in class org.apache.beam.sdk.coders.CoderProvider
-
Returns a Coder<T>
to use for values of a particular type, given the Coders for each of
the type's generic parameter types.
- coderForPrimitiveType(Schema.TypeName) - Static method in class org.apache.beam.sdk.coders.RowCoder
-
Returns the coder used for a given primitive type.
- coderFromCloudObject(CloudObject) - Static method in class org.apache.beam.runners.dataflow.util.CloudObjects
-
- CoderHelpers - Class in org.apache.beam.runners.spark.coders
-
Serialization utility class.
- CoderProperties - Class in org.apache.beam.sdk.testing
-
Properties for use in
Coder
tests.
- CoderProperties() - Constructor for class org.apache.beam.sdk.testing.CoderProperties
-
- CoderProperties.TestElementByteSizeObserver - Class in org.apache.beam.sdk.testing
-
An ElementByteSizeObserver
that records the observed element sizes for testing
purposes.
- CoderProvider - Class in org.apache.beam.sdk.coders
-
- CoderProvider() - Constructor for class org.apache.beam.sdk.coders.CoderProvider
-
- CoderProviderRegistrar - Interface in org.apache.beam.sdk.coders
-
Coder
creators have the ability to automatically have their
coders
registered with this SDK by creating a
ServiceLoader
entry and a concrete implementation
of this interface.
- CoderProviders - Class in org.apache.beam.sdk.coders
-
Static utility methods for creating and working with
CoderProvider
s.
- CoderRegistry - Class in org.apache.beam.sdk.coders
-
- coderSerializable(Coder<T>) - Static method in class org.apache.beam.sdk.testing.CoderProperties
-
Verifies that the given Coder<T>
can be correctly serialized and deserialized.
- CoGbkResult - Class in org.apache.beam.sdk.transforms.join
-
- CoGbkResult(CoGbkResultSchema, Iterable<RawUnionValue>) - Constructor for class org.apache.beam.sdk.transforms.join.CoGbkResult
-
- CoGbkResult(CoGbkResultSchema, Iterable<RawUnionValue>, int) - Constructor for class org.apache.beam.sdk.transforms.join.CoGbkResult
-
- CoGbkResult.CoGbkResultCoder - Class in org.apache.beam.sdk.transforms.join
-
- CoGbkResultSchema - Class in org.apache.beam.sdk.transforms.join
-
- CoGbkResultSchema(TupleTagList) - Constructor for class org.apache.beam.sdk.transforms.join.CoGbkResultSchema
-
Builds a schema from a tuple of TupleTag<?>
s.
- CoGroupByKey<K> - Class in org.apache.beam.sdk.transforms.join
-
- COLLECTION_TYPES - Static variable in enum org.apache.beam.sdk.schemas.Schema.TypeName
-
- CollectionCoder<T> - Class in org.apache.beam.sdk.coders
-
- CollectionCoder(Coder<T>) - Constructor for class org.apache.beam.sdk.coders.CollectionCoder
-
- collectionId() - Method in class org.apache.beam.runners.fnexecution.control.ProcessBundleDescriptors.TimerSpec
-
- column(SqlParserPos, SqlIdentifier, SqlDataTypeSpec, SqlNode) - Static method in class org.apache.beam.sdk.extensions.sql.impl.parser.SqlDdlNodes
-
Creates a column declaration.
- Combine - Class in org.apache.beam.sdk.transforms
-
PTransform
s for combining PCollection
elements globally and per-key.
- combine(Iterable<? extends Instant>) - Method in enum org.apache.beam.sdk.transforms.windowing.TimestampCombiner
-
- combine(Instant...) - Method in enum org.apache.beam.sdk.transforms.windowing.TimestampCombiner
-
- Combine.AccumulatingCombineFn<InputT,AccumT extends Combine.AccumulatingCombineFn.Accumulator<InputT,AccumT,OutputT>,OutputT> - Class in org.apache.beam.sdk.transforms
-
- Combine.AccumulatingCombineFn.Accumulator<InputT,AccumT,OutputT> - Interface in org.apache.beam.sdk.transforms
-
The type of mutable accumulator values used by this AccumulatingCombineFn
.
- Combine.BinaryCombineDoubleFn - Class in org.apache.beam.sdk.transforms
-
An abstract subclass of
Combine.CombineFn
for implementing combiners that are more easily and
efficiently expressed as binary operations on
double
s.
- Combine.BinaryCombineFn<V> - Class in org.apache.beam.sdk.transforms
-
An abstract subclass of
Combine.CombineFn
for implementing combiners that are more easily
expressed as binary operations.
- Combine.BinaryCombineIntegerFn - Class in org.apache.beam.sdk.transforms
-
An abstract subclass of
Combine.CombineFn
for implementing combiners that are more easily and
efficiently expressed as binary operations on
int
s
- Combine.BinaryCombineLongFn - Class in org.apache.beam.sdk.transforms
-
An abstract subclass of
Combine.CombineFn
for implementing combiners that are more easily and
efficiently expressed as binary operations on
long
s.
- Combine.CombineFn<InputT,AccumT,OutputT> - Class in org.apache.beam.sdk.transforms
-
A CombineFn<InputT, AccumT, OutputT>
specifies how to combine a collection of input
values of type InputT
into a single output value of type OutputT
.
- Combine.Globally<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
Combine.Globally<InputT, OutputT>
takes a
PCollection<InputT>
and returns a
PCollection<OutputT>
whose elements are the result of combining all the elements in
each window of the input
PCollection
, using a specified
CombineFn<InputT, AccumT, OutputT>
.
- Combine.GloballyAsSingletonView<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
Combine.GloballyAsSingletonView<InputT, OutputT>
takes a
PCollection<InputT>
and returns a
PCollectionView<OutputT>
whose elements are the result of combining all
the elements in each window of the input
PCollection
, using a specified
CombineFn<InputT, AccumT, OutputT>
.
- Combine.GroupedValues<K,InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
GroupedValues<K, InputT, OutputT>
takes a
PCollection<KV<K, Iterable<InputT>>>
,
such as the result of
GroupByKey
, applies a specified
CombineFn<InputT, AccumT, OutputT>
to each of the input
KV<K, Iterable<InputT>>
elements to produce a combined output
KV<K, OutputT>
element, and returns a
PCollection<KV<K, OutputT>>
containing all the combined output elements.
- Combine.Holder<V> - Class in org.apache.beam.sdk.transforms
-
Holds a single value value of type V
which may or may not be present.
- Combine.IterableCombineFn<V> - Class in org.apache.beam.sdk.transforms
-
- Combine.PerKey<K,InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
PerKey<K, InputT, OutputT>
takes a PCollection<KV<K, InputT>>
, groups it by
key, applies a combining function to the InputT
values associated with each key to
produce a combined OutputT
value, and returns a PCollection<KV<K, OutputT>>
representing a map from each distinct key of the input PCollection
to the corresponding
combined value.
- Combine.PerKeyWithHotKeyFanout<K,InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
- Combine.SimpleCombineFn<V> - Class in org.apache.beam.sdk.transforms
-
Deprecated.
- CombineFn() - Constructor for class org.apache.beam.sdk.transforms.Combine.CombineFn
-
- combineFn() - Static method in class org.apache.beam.sdk.transforms.Count
-
- combineFn() - Static method in class org.apache.beam.sdk.transforms.Latest
-
- combineFn(int) - Static method in class org.apache.beam.sdk.transforms.Sample
-
Returns a
Combine.CombineFn
that computes a fixed-sized uniform sample of its inputs.
- CombineFnBase - Class in org.apache.beam.sdk.transforms
-
For internal use only; no backwards-compatibility guarantees.
- CombineFnBase() - Constructor for class org.apache.beam.sdk.transforms.CombineFnBase
-
- CombineFnBase.GlobalCombineFn<InputT,AccumT,OutputT> - Interface in org.apache.beam.sdk.transforms
-
For internal use only; no backwards-compatibility guarantees.
- CombineFns - Class in org.apache.beam.sdk.transforms
-
Static utility methods that create combine function instances.
- CombineFns() - Constructor for class org.apache.beam.sdk.transforms.CombineFns
-
- CombineFns.CoCombineResult - Class in org.apache.beam.sdk.transforms
-
A tuple of outputs produced by a composed combine functions.
- CombineFns.ComposeCombineFnBuilder - Class in org.apache.beam.sdk.transforms
-
- CombineFns.ComposedCombineFn<DataT> - Class in org.apache.beam.sdk.transforms
-
- CombineFns.ComposedCombineFnWithContext<DataT> - Class in org.apache.beam.sdk.transforms
-
- CombineFnTester - Class in org.apache.beam.sdk.testing
-
- CombineFnTester() - Constructor for class org.apache.beam.sdk.testing.CombineFnTester
-
- CombineFnWithContext() - Constructor for class org.apache.beam.sdk.transforms.CombineWithContext.CombineFnWithContext
-
- CombineWithContext - Class in org.apache.beam.sdk.transforms
-
This class contains combine functions that have access to PipelineOptions
and side inputs
through CombineWithContext.Context
.
- CombineWithContext() - Constructor for class org.apache.beam.sdk.transforms.CombineWithContext
-
- CombineWithContext.CombineFnWithContext<InputT,AccumT,OutputT> - Class in org.apache.beam.sdk.transforms
-
A combine function that has access to PipelineOptions
and side inputs through CombineWithContext.Context
.
- CombineWithContext.Context - Class in org.apache.beam.sdk.transforms
-
Information accessible to all methods in CombineFnWithContext
and KeyedCombineFnWithContext
.
- CombineWithContext.RequiresContextInternal - Interface in org.apache.beam.sdk.transforms
-
An internal interface for signaling that a GloballyCombineFn
or a PerKeyCombineFn
needs to access CombineWithContext.Context
.
- combining(Combine.CombineFn<InputT, AccumT, OutputT>) - Static method in class org.apache.beam.sdk.state.StateSpecs
-
- combining(CombineWithContext.CombineFnWithContext<InputT, AccumT, OutputT>) - Static method in class org.apache.beam.sdk.state.StateSpecs
-
For internal use only; no backwards compatibility guarantees
- combining(Coder<AccumT>, Combine.CombineFn<InputT, AccumT, OutputT>) - Static method in class org.apache.beam.sdk.state.StateSpecs
-
Identical to #combining(CombineFn)
, but with an accumulator coder explicitly supplied.
- combining(Coder<AccumT>, CombineWithContext.CombineFnWithContext<InputT, AccumT, OutputT>) - Static method in class org.apache.beam.sdk.state.StateSpecs
-
For internal use only; no backwards compatibility guarantees
- combiningFromInputInternal(Coder<InputT>, Combine.CombineFn<InputT, AccumT, OutputT>) - Static method in class org.apache.beam.sdk.state.StateSpecs
-
For internal use only; no backwards-compatibility guarantees.
- CombiningState<InputT,AccumT,OutputT> - Interface in org.apache.beam.sdk.state
-
A
ReadableState
cell defined by a
Combine.CombineFn
, accepting multiple input values,
combining them as specified into accumulators, and producing a single output value.
- comment(String) - Method in class org.apache.beam.sdk.extensions.sql.meta.Table.Builder
-
- commit() - Method in class org.apache.beam.runners.fnexecution.splittabledofn.SDFFeederViaStateAndTimers
-
Commits the state and timers: clears both if no checkpoint happened, or adjusts the restriction
and sets a wake-up timer if a checkpoint happened.
- commitManifest(ArtifactApi.CommitManifestRequest, StreamObserver<ArtifactApi.CommitManifestResponse>) - Method in class org.apache.beam.runners.direct.portable.artifact.LocalFileSystemArtifactStagerService
-
- commitManifest(ArtifactApi.CommitManifestRequest, StreamObserver<ArtifactApi.CommitManifestResponse>) - Method in class org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService
-
- commitOffsetsInFinalize() - Method in class org.apache.beam.sdk.io.kafka.KafkaIO.Read
-
Finalized offsets are committed to Kafka.
- commonPrefixLength(RandomAccessData, RandomAccessData) - Method in class org.apache.beam.runners.dataflow.util.RandomAccessData.UnsignedLexicographicalComparator
-
Compute the length of the common prefix of the two provided sets of bytes.
- compact(AccumT) - Method in class org.apache.beam.sdk.transforms.Combine.CombineFn
-
Returns an accumulator that represents the same logical value as the input accumulator, but
may have a more compact representation.
- compact(List<V>) - Method in class org.apache.beam.sdk.transforms.Combine.IterableCombineFn
-
- compact(Object[]) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFn
-
- compact(Object[], CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFnWithContext
-
- compact(AccumT, CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineWithContext.CombineFnWithContext
-
Returns an accumulator that represents the same logical value as the input accumulator, but
may have a more compact representation.
- compare(JobMessage, JobMessage) - Method in class org.apache.beam.runners.dataflow.util.MonitoringUtil.TimeStampComparator
-
- compare(RandomAccessData, RandomAccessData) - Method in class org.apache.beam.runners.dataflow.util.RandomAccessData.UnsignedLexicographicalComparator
-
- compare(RandomAccessData, RandomAccessData, int) - Method in class org.apache.beam.runners.dataflow.util.RandomAccessData.UnsignedLexicographicalComparator
-
Compare the two sets of bytes starting at the given offset.
- compare(CharSequence, CharSequence) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlCompareExpression
-
Compare between String values, mapping to SqlTypeName.VARCHAR
.
- compare(Boolean, Boolean) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlCompareExpression
-
Compare between Boolean values, mapping to SqlTypeName.BOOLEAN
.
- compare(Number, Number) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlCompareExpression
-
Compare between Number values, including SqlTypeName.BIGINT
, SqlTypeName.DECIMAL
, SqlTypeName.DOUBLE
, SqlTypeName.FLOAT
, SqlTypeName.INTEGER
, SqlTypeName.SMALLINT
and SqlTypeName.TINYINT
.
- compare(DateTime, DateTime) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlCompareExpression
-
Compare between DateTime values, mapping to SqlTypeName.DATETIME_TYPES
.
- compare(CharSequence, CharSequence) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlEqualsExpression
-
- compare(Boolean, Boolean) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlEqualsExpression
-
- compare(Number, Number) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlEqualsExpression
-
- compare(DateTime, DateTime) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlEqualsExpression
-
- compare(CharSequence, CharSequence) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlGreaterThanExpression
-
- compare(Boolean, Boolean) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlGreaterThanExpression
-
- compare(Number, Number) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlGreaterThanExpression
-
- compare(DateTime, DateTime) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlGreaterThanExpression
-
- compare(CharSequence, CharSequence) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlGreaterThanOrEqualsExpression
-
- compare(Boolean, Boolean) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlGreaterThanOrEqualsExpression
-
- compare(Number, Number) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlGreaterThanOrEqualsExpression
-
- compare(DateTime, DateTime) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlGreaterThanOrEqualsExpression
-
- compare(CharSequence, CharSequence) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLessThanExpression
-
- compare(Boolean, Boolean) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLessThanExpression
-
- compare(Number, Number) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLessThanExpression
-
- compare(DateTime, DateTime) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLessThanExpression
-
- compare(CharSequence, CharSequence) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLessThanOrEqualsExpression
-
- compare(Boolean, Boolean) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLessThanOrEqualsExpression
-
- compare(Number, Number) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLessThanOrEqualsExpression
-
- compare(DateTime, DateTime) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLessThanOrEqualsExpression
-
- compare(CharSequence, CharSequence) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLikeExpression
-
- compare(Boolean, Boolean) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLikeExpression
-
- compare(Number, Number) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLikeExpression
-
- compare(DateTime, DateTime) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlLikeExpression
-
- compare(CharSequence, CharSequence) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlNotEqualsExpression
-
- compare(Boolean, Boolean) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlNotEqualsExpression
-
- compare(Number, Number) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlNotEqualsExpression
-
- compare(DateTime, DateTime) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlNotEqualsExpression
-
- compare(CharSequence, CharSequence) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlNotLikeExpression
-
- compare(Boolean, Boolean) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlNotLikeExpression
-
- compare(Number, Number) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlNotLikeExpression
-
- compare(DateTime, DateTime) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.comparison.BeamSqlNotLikeExpression
-
- compare(T, T) - Method in class org.apache.beam.sdk.transforms.Top.Largest
-
Deprecated.
- compare(T, T) - Method in class org.apache.beam.sdk.transforms.Top.Natural
-
- compare(T, T) - Method in class org.apache.beam.sdk.transforms.Top.Reversed
-
- compare(T, T) - Method in class org.apache.beam.sdk.transforms.Top.Smallest
-
Deprecated.
- compare(KV<K, V>, KV<K, V>) - Method in class org.apache.beam.sdk.values.KV.OrderByKey
-
- compare(KV<K, V>, KV<K, V>) - Method in class org.apache.beam.sdk.values.KV.OrderByValue
-
- compareTo(ByteArray) - Method in class org.apache.beam.runners.spark.util.ByteArray
-
- compareTo(ByteKey) - Method in class org.apache.beam.sdk.io.range.ByteKey
-
ByteKey
implements
Comparable<ByteKey>
by comparing the arrays
in lexicographic order.
- compareTo(IntervalWindow) - Method in class org.apache.beam.sdk.transforms.windowing.IntervalWindow
-
- CompletableFutureInboundDataClient - Class in org.apache.beam.sdk.fn.data
-
- complete() - Method in class org.apache.beam.sdk.fn.data.BeamFnDataInboundObserver
-
- complete() - Method in class org.apache.beam.sdk.fn.data.CompletableFutureInboundDataClient
-
- complete() - Method in interface org.apache.beam.sdk.fn.data.InboundDataClient
-
Mark the client as completed.
- complete(List<TimestampedValue<OutputT>>) - Static method in class org.apache.beam.sdk.transforms.Watch.Growth.PollResult
-
Constructs a
Watch.Growth.PollResult
with the given outputs and declares that there will be no
new outputs for the current input.
- complete(Instant, List<OutputT>) - Static method in class org.apache.beam.sdk.transforms.Watch.Growth.PollResult
-
- completed() - Method in interface org.apache.beam.runners.local.PipelineMessageReceiver
-
Report that the pipeline has successfully completed.
- COMPONENT_ENCODINGS - Static variable in class org.apache.beam.runners.dataflow.util.PropertyNames
-
- compose() - Static method in class org.apache.beam.sdk.transforms.CombineFns
-
- ComposeCombineFnBuilder() - Constructor for class org.apache.beam.sdk.transforms.CombineFns.ComposeCombineFnBuilder
-
- COMPOSITE_TYPES - Static variable in enum org.apache.beam.sdk.schemas.Schema.TypeName
-
- CompositeSource - Class in org.apache.beam.runners.spark.metrics
-
Composite source made up of several MetricRegistry
instances.
- CompositeSource(String, MetricRegistry...) - Constructor for class org.apache.beam.runners.spark.metrics.CompositeSource
-
- CompressedReader(CompressedSource<T>, FileBasedSource.FileBasedReader<T>) - Constructor for class org.apache.beam.sdk.io.CompressedSource.CompressedReader
-
Create a CompressedReader
from a CompressedSource
and delegate reader.
- CompressedSource<T> - Class in org.apache.beam.sdk.io
-
A Source that reads from compressed files.
- CompressedSource.CompressedReader<T> - Class in org.apache.beam.sdk.io
-
- CompressedSource.CompressionMode - Enum in org.apache.beam.sdk.io
-
- CompressedSource.DecompressingChannelFactory - Interface in org.apache.beam.sdk.io
-
Factory interface for creating channels that decompress the content of an underlying channel.
- Compression - Enum in org.apache.beam.sdk.io
-
Various compression types for reading/writing files.
- compute(Partition, TaskContext) - Method in class org.apache.beam.runners.spark.io.SourceRDD.Bounded
-
- compute(Partition, TaskContext) - Method in class org.apache.beam.runners.spark.io.SourceRDD.Unbounded
-
- computeSelfCost(RelOptPlanner, RelMetadataQuery) - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamEnumerableConverter
-
- CONCAT - Static variable in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.StringOperators
-
- CONCRETE_CLASS - Static variable in class org.apache.beam.sdk.io.WriteFiles
-
For internal use by runners.
- ConfigurationLocator() - Constructor for class org.apache.beam.sdk.io.hdfs.HadoopFileSystemOptions.ConfigurationLocator
-
- configure(Map<String, ?>, boolean) - Method in class org.apache.beam.sdk.io.kafka.serialization.InstantDeserializer
-
- configure(Map<String, ?>, boolean) - Method in class org.apache.beam.sdk.io.kafka.serialization.InstantSerializer
-
- configure() - Static method in class org.apache.beam.sdk.transforms.windowing.Window
-
Returns a new builder for a
Window
transform for setting windowing parameters other
than the windowing function.
- connect(String, Properties) - Method in class org.apache.beam.sdk.extensions.sql.impl.JdbcDriver
-
- connect(TableProvider) - Static method in class org.apache.beam.sdk.extensions.sql.impl.JdbcDriver
-
- connect() - Method in class org.apache.beam.sdk.io.redis.RedisConnectionConfiguration
-
Connect to the Redis instance.
- CONNECT_STRING_PREFIX - Static variable in class org.apache.beam.sdk.extensions.sql.impl.JdbcDriver
-
- ConnectionConfiguration() - Constructor for class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration
-
- ConnectionConfiguration() - Constructor for class org.apache.beam.sdk.io.mongodb.MongoDbGridFSIO.ConnectionConfiguration
-
- ConnectionConfiguration() - Constructor for class org.apache.beam.sdk.io.mqtt.MqttIO.ConnectionConfiguration
-
- ConnectionConfiguration() - Constructor for class org.apache.beam.sdk.io.solr.SolrIO.ConnectionConfiguration
-
- connectToSpanner() - Method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig
-
- consistentWithEquals() - Method in class org.apache.beam.runners.dataflow.util.RandomAccessData.RandomAccessDataCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.BigDecimalCoder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.BigEndianIntegerCoder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.BigEndianLongCoder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.BigEndianShortCoder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.BigIntegerCoder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.BitSetCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.BooleanCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.ByteCoder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.Coder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.DoubleCoder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.DurationCoder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.FloatCoder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.InstantCoder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.KvCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.LengthPrefixCoder
-
LengthPrefixCoder
is consistent with equals if the nested Coder
is.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.NullableCoder
-
NullableCoder
is consistent with equals if the nested Coder
is.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.RowCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.SerializableCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.StringUtf8Coder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.VarIntCoder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.coders.VarLongCoder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.extensions.protobuf.ByteStringCoder
-
Returns
true
if this
Coder
is injective with respect to
Object.equals(java.lang.Object)
.
- consistentWithEquals() - Method in class org.apache.beam.sdk.fn.windowing.EncodedBoundedWindow.Coder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.io.fs.MetadataCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.io.fs.ResourceIdCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.io.kafka.KafkaRecordCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.schemas.SchemaCoder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.transforms.windowing.GlobalWindow.Coder
-
- consistentWithEquals() - Method in class org.apache.beam.sdk.transforms.windowing.IntervalWindow.IntervalWindowCoder
-
- ConsoleIO - Class in org.apache.beam.runners.spark.io
-
Print to console.
- ConsoleIO.Write - Class in org.apache.beam.runners.spark.io
-
Write to console.
- ConsoleIO.Write.Unbound<T> - Class in org.apache.beam.runners.spark.io
-
- constant(FileBasedSink.FilenamePolicy, SerializableFunction<UserT, OutputT>) - Static method in class org.apache.beam.sdk.io.DynamicFileDestinations
-
- constant(FileBasedSink.FilenamePolicy) - Static method in class org.apache.beam.sdk.io.DynamicFileDestinations
-
A specialization of #constant(FilenamePolicy, SerializableFunction)
for the case where
UserT and OutputT are the same type and the format function is the identity.
- constant(OutT) - Static method in class org.apache.beam.sdk.transforms.SerializableFunctions
-
- constantDestinations(FileBasedSink.FilenamePolicy, Schema, Map<String, Object>, CodecFactory, SerializableFunction<UserT, OutputT>) - Static method in class org.apache.beam.sdk.io.AvroIO
-
- contains(PCollectionView<T>) - Method in class org.apache.beam.runners.spark.util.SparkSideInputReader
-
- contains(T) - Method in interface org.apache.beam.sdk.state.SetState
-
Returns true if this set contains the specified element.
- contains(IntervalWindow) - Method in class org.apache.beam.sdk.transforms.windowing.IntervalWindow
-
Returns whether this window contains the given window.
- containsInAnyOrder(T...) - Method in interface org.apache.beam.sdk.testing.PAssert.IterableAssert
-
Asserts that the iterable in question contains the provided elements.
- containsInAnyOrder(Iterable<T>) - Method in interface org.apache.beam.sdk.testing.PAssert.IterableAssert
-
Asserts that the iterable in question contains the provided elements.
- containsInAnyOrder(T...) - Method in class org.apache.beam.sdk.testing.PAssert.PCollectionContentsAssert
-
Checks that the Iterable
contains the expected elements, in any order.
- containsInAnyOrder(Iterable<T>) - Method in class org.apache.beam.sdk.testing.PAssert.PCollectionContentsAssert
-
Checks that the Iterable
contains the expected elements, in any order.
- containsKey(ByteKey) - Method in class org.apache.beam.sdk.io.range.ByteKeyRange
-
Returns
true
if the specified
ByteKey
is contained within this range.
- Context(boolean) - Constructor for class org.apache.beam.sdk.coders.Coder.Context
-
Deprecated.
- Context(TableDataInsertAllResponse.InsertErrors) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.InsertRetryPolicy.Context
-
- Context() - Constructor for class org.apache.beam.sdk.transforms.CombineWithContext.Context
-
- Context() - Constructor for class org.apache.beam.sdk.transforms.Contextful.Fn.Context
-
- Contextful<ClosureT> - Class in org.apache.beam.sdk.transforms
-
Pair of a bit of user code (a "closure") and the
Requirements
needed to run it.
- Contextful.Fn<InputT,OutputT> - Interface in org.apache.beam.sdk.transforms
-
A function from an input to an output that may additionally access
Contextful.Fn.Context
when
computing the result.
- Contextful.Fn.Context - Class in org.apache.beam.sdk.transforms
-
- continuously(Duration, Watch.Growth.TerminationCondition<String, ?>) - Method in class org.apache.beam.sdk.io.FileIO.Match
-
- continuously(Duration, Watch.Growth.TerminationCondition<String, ?>) - Method in class org.apache.beam.sdk.io.FileIO.MatchAll
-
- continuously(Duration, Watch.Growth.TerminationCondition<String, ?>) - Method in class org.apache.beam.sdk.io.FileIO.MatchConfiguration
-
Continuously watches for new files at the given interval until the given termination
condition is reached, where the input to the condition is the filepattern.
- control(StreamObserver<BeamFnApi.InstructionRequest>) - Method in class org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService
-
Called by gRPC for each incoming connection from an SDK harness, and enqueue an available SDK
harness client.
- ControlClientPool - Interface in org.apache.beam.runners.fnexecution.control
-
- ControlClientPool.Sink - Interface in org.apache.beam.runners.fnexecution.control
-
- ControlClientPool.Source - Interface in org.apache.beam.runners.fnexecution.control
-
- convert(Function<BeamSqlPrimitive, BeamSqlPrimitive>) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret.ReinterpretConversion.Builder
-
- convert(BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret.ReinterpretConversion
-
- convert(SqlTypeName, BeamSqlPrimitive) - Method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret.Reinterpreter
-
- convert(RelNode) - Method in class org.apache.beam.sdk.extensions.sql.impl.rule.BeamCalcRule
-
- convert(RelNode) - Method in class org.apache.beam.sdk.extensions.sql.impl.rule.BeamEnumerableConverterRule
-
- convert(RelNode) - Method in class org.apache.beam.sdk.extensions.sql.impl.rule.BeamIntersectRule
-
- convert(RelNode) - Method in class org.apache.beam.sdk.extensions.sql.impl.rule.BeamIOSinkRule
-
- convert(RelNode) - Method in class org.apache.beam.sdk.extensions.sql.impl.rule.BeamJoinRule
-
- convert(RelNode) - Method in class org.apache.beam.sdk.extensions.sql.impl.rule.BeamMinusRule
-
- convert(RelNode) - Method in class org.apache.beam.sdk.extensions.sql.impl.rule.BeamSortRule
-
- convert(RelNode) - Method in class org.apache.beam.sdk.extensions.sql.impl.rule.BeamUncollectRule
-
- convert(RelNode) - Method in class org.apache.beam.sdk.extensions.sql.impl.rule.BeamUnionRule
-
- convert(RelNode) - Method in class org.apache.beam.sdk.extensions.sql.impl.rule.BeamValuesRule
-
- Convert - Class in org.apache.beam.sdk.schemas.transforms
-
A set of utilities for converting between different objects supporting schemas.
- Convert() - Constructor for class org.apache.beam.sdk.schemas.transforms.Convert
-
- convertAvroFormat(Schema.Field, Object) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.AvroUtils
-
- convertToBagSpecInternal(StateSpec<CombiningState<InputT, AccumT, OutputT>>) - Static method in class org.apache.beam.sdk.state.StateSpecs
-
For internal use only; no backwards-compatibility guarantees.
- convertToFileResourceIfPossible(String) - Static method in class org.apache.beam.sdk.io.FileBasedSink
-
This is a helper function for turning a user-provided output filename prefix and converting it
into a
ResourceId
for writing output files.
- copy() - Method in class org.apache.beam.runners.dataflow.util.RandomAccessData
-
Returns a copy of this RandomAccessData.
- copy(RelTraitSet, RelNode, boolean, ImmutableBitSet, List<ImmutableBitSet>, List<AggregateCall>) - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamAggregationRel
-
- copy(RelTraitSet, RelNode, RexProgram) - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamCalcRel
-
- copy(RelTraitSet, List<RelNode>) - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamEnumerableConverter
-
- copy(RelTraitSet, List<RelNode>, boolean) - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamIntersectRel
-
- copy(RelTraitSet, List<RelNode>) - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamIOSinkRel
-
- copy(RelTraitSet, RexNode, RelNode, RelNode, JoinRelType, boolean) - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamJoinRel
-
- copy(RelTraitSet, List<RelNode>, boolean) - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamMinusRel
-
- copy(RelTraitSet, RelNode, RelCollation, RexNode, RexNode) - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamSortRel
-
- copy(RelTraitSet, RelNode) - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamUncollectRel
-
- copy(RelTraitSet, List<RelNode>, boolean) - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamUnionRel
-
- copy(RelTraitSet, RelNode, RelNode, CorrelationId, ImmutableBitSet, SemiJoinType) - Method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamUnnestRel
-
- copy(List<ResourceIdT>, List<ResourceIdT>) - Method in class org.apache.beam.sdk.io.FileSystem
-
Copies a List
of file-like resources from one location to another.
- copy(List<ResourceId>, List<ResourceId>, MoveOptions...) - Static method in class org.apache.beam.sdk.io.FileSystems
-
Copies a List
of file-like resources from one location to another.
- copyFrom(ByteBuffer) - Static method in class org.apache.beam.sdk.io.range.ByteKey
-
Creates a new
ByteKey
backed by a copy of the data remaining in the specified
ByteBuffer
.
- copyFrom(byte[]) - Static method in class org.apache.beam.sdk.io.range.ByteKey
-
Creates a new
ByteKey
backed by a copy of the specified
byte[]
.
- copyWithLocalRefExprs(List<BeamSqlExpression>) - Method in interface org.apache.beam.sdk.extensions.sql.impl.interpreter.BeamSqlExpressionEnvironment
-
An environment that shares input row, window, and correlation variables but local refs are
replaced with the given unevaluated expressions.
- Count - Class in org.apache.beam.sdk.transforms
-
- countAsserts(Pipeline) - Static method in class org.apache.beam.sdk.testing.PAssert
-
- Counter - Interface in org.apache.beam.sdk.metrics
-
A metric that reports a single long value and can be incremented or decremented.
- counter(String, String) - Static method in class org.apache.beam.sdk.metrics.Metrics
-
Create a metric that can be incremented and decremented, and is aggregated by taking the sum.
- counter(Class<?>, String) - Static method in class org.apache.beam.sdk.metrics.Metrics
-
Create a metric that can be incremented and decremented, and is aggregated by taking the sum.
- CounterMark(long, Instant) - Constructor for class org.apache.beam.sdk.io.CountingSource.CounterMark
-
Creates a checkpoint mark reflecting the last emitted value.
- CountingSource - Class in org.apache.beam.sdk.io
-
- CountingSource.CounterMark - Class in org.apache.beam.sdk.io
-
The checkpoint for an unbounded
CountingSource
is simply the last value produced.
- CovarianceFn<T extends java.lang.Number> - Class in org.apache.beam.sdk.extensions.sql.impl.transform.agg
-
Combine.CombineFn
for Covariance on Number
types.
- CrashingRunner - Class in org.apache.beam.sdk.testing
-
- CrashingRunner() - Constructor for class org.apache.beam.sdk.testing.CrashingRunner
-
- create(DataflowPipelineOptions) - Static method in class org.apache.beam.runners.dataflow.DataflowClient
-
- create(PCollectionView<?>, Coder<T>) - Static method in class org.apache.beam.runners.dataflow.DataflowRunner.StreamingPCollectionViewWriterFn
-
- create(PipelineOptions) - Method in class org.apache.beam.runners.dataflow.options.DataflowPipelineDebugOptions.DataflowClientFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.runners.dataflow.options.DataflowPipelineDebugOptions.StagerFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.runners.dataflow.options.DataflowPipelineOptions.StagingLocationFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.runners.dataflow.options.DataflowPipelineWorkerPoolOptions.WorkerHarnessContainerImageFactory
-
- create() - Static method in class org.apache.beam.runners.dataflow.PrimitiveParDoSingleFactory.PayloadTranslator
-
- create(PipelineOptions) - Method in class org.apache.beam.runners.direct.DirectOptions.AvailableParallelismFactory
-
- create() - Static method in class org.apache.beam.runners.direct.portable.artifact.UnsupportedArtifactRetrievalService
-
- create(ServerFactory) - Static method in class org.apache.beam.runners.direct.portable.job.ReferenceRunnerJobService
-
- create(Clock, ExecutableGraph<ExecutableT, ? super CollectionT>, Function<ExecutableT, String>) - Static method in class org.apache.beam.runners.direct.WatermarkManager
-
- create(PipelineOptions) - Method in class org.apache.beam.runners.flink.DefaultParallelismFactory
-
- create(String, String, ListeningExecutorService, RunnerApi.Pipeline, FlinkPipelineOptions, List<String>) - Static method in class org.apache.beam.runners.flink.FlinkJobInvocation
-
- create(ListeningExecutorService, String) - Static method in class org.apache.beam.runners.flink.FlinkJobInvoker
-
- create(FlinkJobServerDriver.ServerConfiguration, ListeningExecutorService, ServerFactory, ServerFactory) - Static method in class org.apache.beam.runners.flink.FlinkJobServerDriver
-
- create(boolean) - Static method in class org.apache.beam.runners.flink.TestFlinkRunner
-
- create() - Static method in class org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService
-
- create(JobInfo) - Static method in class org.apache.beam.runners.fnexecution.control.DockerJobBundleFactory
-
- create(JobInfo) - Method in interface org.apache.beam.runners.fnexecution.control.DockerJobBundleFactory.JobBundleFactoryFactory
-
- create() - Static method in class org.apache.beam.runners.fnexecution.control.MapControlClientPool
-
- create(String) - Method in interface org.apache.beam.runners.fnexecution.control.OutputReceiverFactory
-
- create(EnvironmentFactory, GrpcFnServer<GrpcDataService>, GrpcFnServer<GrpcStateService>) - Static method in class org.apache.beam.runners.fnexecution.control.SingleEnvironmentInstanceJobBundleFactory
-
Deprecated.
- create(ExecutorService, OutboundObserverFactory) - Static method in class org.apache.beam.runners.fnexecution.data.GrpcDataService
-
- create(PipelineOptions, GrpcFnServer<GrpcLoggingService>, GrpcFnServer<FnApiControlClientPoolService>, ControlClientPool.Source) - Static method in class org.apache.beam.runners.fnexecution.environment.InProcessEnvironmentFactory
-
- create(ServiceT, Endpoints.ApiServiceDescriptor, ServerFactory) - Static method in class org.apache.beam.runners.fnexecution.GrpcFnServer
-
Create a
GrpcFnServer
for the provided
FnService
which will run at the endpoint
specified in the
Endpoints.ApiServiceDescriptor
.
- create() - Static method in class org.apache.beam.runners.fnexecution.InProcessServerFactory
-
- create(BindableService, Endpoints.ApiServiceDescriptor) - Method in class org.apache.beam.runners.fnexecution.InProcessServerFactory
-
- create(Endpoints.ApiServiceDescriptor, Function<String, String>, ThrowingConsumer<String>, JobInvoker) - Static method in class org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService
-
Creates an InMemoryJobService.
- create(String, String, String, Struct) - Static method in class org.apache.beam.runners.fnexecution.provisioning.JobInfo
-
- create(ProvisionApi.ProvisionInfo) - Static method in class org.apache.beam.runners.fnexecution.provisioning.StaticGrpcProvisionService
-
- create(BindableService, Endpoints.ApiServiceDescriptor) - Method in class org.apache.beam.runners.fnexecution.ServerFactory
-
Creates an instance of this server at the address specified by the given service descriptor.
- create(BindableService, Endpoints.ApiServiceDescriptor) - Method in class org.apache.beam.runners.fnexecution.ServerFactory.InetSocketAddressServerFactory
-
- create() - Static method in class org.apache.beam.runners.fnexecution.state.GrpcStateService
-
- create(PipelineOptions) - Method in class org.apache.beam.runners.reference.testing.TestPortablePipelineOptions.DefaultJobServerConfigFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.runners.spark.SparkContextOptions.EmptyListenersList
-
- create(PipelineOptions) - Method in class org.apache.beam.runners.spark.SparkPipelineOptions.TmpCheckpointDirFactory
-
- create() - Static method in class org.apache.beam.runners.spark.SparkRunner
-
Creates and returns a new SparkRunner with default options.
- create(SparkPipelineOptions) - Static method in class org.apache.beam.runners.spark.SparkRunner
-
Creates and returns a new SparkRunner with specified options.
- create(PipelineOptions) - Method in class org.apache.beam.runners.spark.TestSparkPipelineOptions.DefaultStopPipelineWatermarkFactory
-
- create(byte[], Coder<T>) - Static method in class org.apache.beam.runners.spark.util.SideInputBroadcast
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.extensions.gcp.options.GcpOptions.DefaultProjectFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.extensions.gcp.options.GcpOptions.GcpTempLocationFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.extensions.gcp.options.GcpOptions.GcpUserCredentialsFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.extensions.gcp.options.GcsOptions.ExecutorServiceFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.extensions.gcp.options.GcsOptions.PathValidatorFactory
-
- create(Coder<InputT>) - Static method in class org.apache.beam.sdk.extensions.sketching.ApproximateDistinct.ApproximateDistinctFn
-
- create(Coder<InputT>) - Static method in class org.apache.beam.sdk.extensions.sketching.SketchFrequencies.CountMinSketchFn
-
- create(double) - Static method in class org.apache.beam.sdk.extensions.sketching.TDigestQuantiles.TDigestQuantilesFn
-
- create(BufferedExternalSorter.Options) - Static method in class org.apache.beam.sdk.extensions.sorter.BufferedExternalSorter
-
- create(BufferedExternalSorter.Options) - Static method in class org.apache.beam.sdk.extensions.sorter.SortValues
-
Returns a
SortValues<PrimaryKeyT, SecondaryKeyT, ValueT>
PTransform
.
- create(SchemaPlus, String, Map<String, Object>) - Method in class org.apache.beam.sdk.extensions.sql.impl.BeamCalciteSchemaFactory
-
- create() - Static method in class org.apache.beam.sdk.fn.data.CompletableFutureInboundDataClient
-
- create(StreamObserver<ReqT>, Runnable) - Static method in class org.apache.beam.sdk.fn.stream.ForwardingClientResponseObserver
-
- create() - Static method in class org.apache.beam.sdk.fn.test.InProcessManagedChannelFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws.options.AwsOptions.AwsUserCredentialsFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws.options.AwsOptions.ClientConfigurationFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.io.aws.options.S3Options.S3UploadBufferSizeBytesFactory
-
- create(int, Duration) - Static method in class org.apache.beam.sdk.io.aws.sns.SnsIO.RetryConfiguration
-
- create(String[], String, String) - Static method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.ConnectionConfiguration
-
Creates a new Elasticsearch connection configuration.
- create(int, Duration) - Static method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.RetryConfiguration
-
Creates RetryConfiguration for
ElasticsearchIO
with provided maxAttempts,
maxDurations and exponential backoff based retries.
- create(WritableByteChannel) - Method in enum org.apache.beam.sdk.io.FileBasedSink.CompressionType
-
Deprecated.
- create(WritableByteChannel) - Method in interface org.apache.beam.sdk.io.FileBasedSink.WritableByteChannelFactory
-
- create(EmptyMatchTreatment) - Static method in class org.apache.beam.sdk.io.FileIO.MatchConfiguration
-
- create(ResourceIdT, CreateOptions) - Method in class org.apache.beam.sdk.io.FileSystem
-
Returns a write channel for the given ResourceIdT
.
- create(ResourceId, String) - Static method in class org.apache.beam.sdk.io.FileSystems
-
- create(ResourceId, CreateOptions) - Static method in class org.apache.beam.sdk.io.FileSystems
-
- create(MatchResult.Status, List<MatchResult.Metadata>) - Static method in class org.apache.beam.sdk.io.fs.MatchResult
-
- create(MatchResult.Status, IOException) - Static method in class org.apache.beam.sdk.io.fs.MatchResult
-
- create(Schema) - Static method in class org.apache.beam.sdk.io.gcp.bigquery.TestBigQuery
-
Creates an instance of this rule.
- create() - Static method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsub
-
Creates an instance of this rule.
- create() - Static method in class org.apache.beam.sdk.io.gcp.pubsub.TestPubsubSignal
-
Creates an instance of this rule.
- create(Mutation, Mutation...) - Static method in class org.apache.beam.sdk.io.gcp.spanner.MutationGroup
-
Creates a new group.
- create(Mutation, Iterable<Mutation>) - Static method in class org.apache.beam.sdk.io.gcp.spanner.MutationGroup
-
- create() - Static method in class org.apache.beam.sdk.io.gcp.spanner.ReadOperation
-
- create() - Static method in class org.apache.beam.sdk.io.gcp.spanner.SpannerConfig
-
- create(BatchTransactionId) - Static method in class org.apache.beam.sdk.io.gcp.spanner.Transaction
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.io.hdfs.HadoopFileSystemOptions.ConfigurationLocator
-
- create(DataSource) - Static method in class org.apache.beam.sdk.io.jdbc.JdbcIO.DataSourceConfiguration
-
- create(String, String) - Static method in class org.apache.beam.sdk.io.jdbc.JdbcIO.DataSourceConfiguration
-
- create(ValueProvider<String>, ValueProvider<String>) - Static method in class org.apache.beam.sdk.io.jdbc.JdbcIO.DataSourceConfiguration
-
- create(String, String) - Static method in class org.apache.beam.sdk.io.mqtt.MqttIO.ConnectionConfiguration
-
Describe a connection configuration to the MQTT broker.
- create(String, String, String) - Static method in class org.apache.beam.sdk.io.mqtt.MqttIO.ConnectionConfiguration
-
Describe a connection configuration to the MQTT broker.
- create() - Static method in class org.apache.beam.sdk.io.redis.RedisConnectionConfiguration
-
- create(String, int) - Static method in class org.apache.beam.sdk.io.redis.RedisConnectionConfiguration
-
- create(String) - Static method in class org.apache.beam.sdk.io.solr.SolrIO.ConnectionConfiguration
-
Creates a new Solr connection configuration.
- create(int, Duration) - Static method in class org.apache.beam.sdk.io.solr.SolrIO.RetryConfiguration
-
- create(long, long, long, long) - Static method in class org.apache.beam.sdk.metrics.DistributionResult
-
- create(long, Instant) - Static method in class org.apache.beam.sdk.metrics.GaugeResult
-
- create(PipelineOptions) - Method in interface org.apache.beam.sdk.options.DefaultValueFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.options.PipelineOptions.AtomicLongFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.options.PipelineOptions.DirectRunner
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.options.PipelineOptions.JobNameFactory
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.options.PipelineOptions.NoOpMetricsSink
-
- create(PipelineOptions) - Method in class org.apache.beam.sdk.options.PipelineOptions.UserAgentFactory
-
- create() - Method in class org.apache.beam.sdk.options.PipelineOptionsFactory.Builder
-
Creates and returns an object that implements
PipelineOptions
using the values
configured on this builder during construction.
- create() - Static method in class org.apache.beam.sdk.options.PipelineOptionsFactory
-
- create() - Static method in class org.apache.beam.sdk.Pipeline
-
- create(PipelineOptions) - Static method in class org.apache.beam.sdk.Pipeline
-
- create() - Static method in class org.apache.beam.sdk.PipelineRunner
-
- create() - Static method in class org.apache.beam.sdk.schemas.FieldAccessDescriptor
-
- create() - Static method in class org.apache.beam.sdk.schemas.transforms.Filter
-
- create() - Static method in class org.apache.beam.sdk.testing.TestPipeline
-
Creates and returns a new test pipeline.
- create(PipelineOptions) - Method in class org.apache.beam.sdk.testing.TestPipelineOptions.AlwaysPassMatcherFactory
-
- create(Coder<T>) - Static method in class org.apache.beam.sdk.testing.TestStream
-
- create(Schema, SerializableFunction<T, Row>, SerializableFunction<Row, T>) - Static method in class org.apache.beam.sdk.testing.TestStream
-
- create(int, ComparatorT) - Static method in class org.apache.beam.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
-
Returns an approximate quantiles combiner with the given compareFn
and desired number
of quantiles.
- create(int) - Static method in class org.apache.beam.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
-
- create(int, ComparatorT, long, double) - Static method in class org.apache.beam.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
-
Creates an approximate quantiles combiner with the given compareFn
and desired number
of quantiles.
- Create<T> - Class in org.apache.beam.sdk.transforms
-
Create<T>
takes a collection of elements of type T
known when the pipeline is
constructed and returns a PCollection<T>
containing the elements.
- Create() - Constructor for class org.apache.beam.sdk.transforms.Create
-
- create() - Static method in class org.apache.beam.sdk.transforms.Distinct
-
Returns a Distinct<T>
PTransform
.
- create() - Static method in class org.apache.beam.sdk.transforms.GroupByKey
-
Returns a GroupByKey<K, V>
PTransform
.
- create() - Static method in class org.apache.beam.sdk.transforms.Impulse
-
- create() - Static method in class org.apache.beam.sdk.transforms.join.CoGroupByKey
-
Returns a CoGroupByKey<K>
PTransform
.
- create() - Static method in class org.apache.beam.sdk.transforms.Keys
-
Returns a Keys<K>
PTransform
.
- create() - Static method in class org.apache.beam.sdk.transforms.KvSwap
-
Returns a KvSwap<K, V>
PTransform
.
- create() - Static method in class org.apache.beam.sdk.transforms.Values
-
Returns a Values<V>
PTransform
.
- Create.OfValueProvider<T> - Class in org.apache.beam.sdk.transforms
-
- Create.TimestampedValues<T> - Class in org.apache.beam.sdk.transforms
-
A PTransform
that creates a PCollection
whose elements have associated
timestamps.
- Create.Values<T> - Class in org.apache.beam.sdk.transforms
-
A PTransform
that creates a PCollection
from a set of in-memory objects.
- createAccumulator() - Method in class org.apache.beam.sdk.extensions.sketching.ApproximateDistinct.ApproximateDistinctFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.extensions.sketching.SketchFrequencies.CountMinSketchFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.extensions.sketching.TDigestQuantiles.TDigestQuantilesFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.extensions.sql.impl.transform.agg.CovarianceFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.extensions.sql.impl.transform.agg.VarianceFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.extensions.sql.impl.transform.BeamAggregationTransforms.AggregationAdaptor
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.ApproximateUnique.ApproximateUniqueCombineFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineDoubleFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineIntegerFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Combine.BinaryCombineLongFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Combine.CombineFn
-
Returns a new, mutable accumulator value, representing the accumulation of zero input values.
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Combine.IterableCombineFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFn
-
- createAccumulator(CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineFns.ComposedCombineFnWithContext
-
- createAccumulator(CombineWithContext.Context) - Method in class org.apache.beam.sdk.transforms.CombineWithContext.CombineFnWithContext
-
Returns a new, mutable accumulator value, representing the accumulation of zero input values.
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Sample.FixedSizedSampleFn
-
- createAccumulator() - Method in class org.apache.beam.sdk.transforms.Top.TopCombineFn
-
- createBatchExecutionEnvironment(FlinkPipelineOptions, List<String>) - Static method in class org.apache.beam.runners.flink.FlinkExecutionEnvironments
-
If the submitted job is a batch processing job, this method creates the adequate Flink ExecutionEnvironment
depending on the user-specified options.
- createContextual(DeserializationContext, BeanProperty) - Method in class org.apache.beam.sdk.options.ValueProvider.Deserializer
-
- CreateDataflowView<ElemT,ViewT> - Class in org.apache.beam.runners.dataflow
-
- createDataset(String, String, String, String, Long) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService
-
Create a
Dataset
with the given
location
,
description
and default
expiration time for tables in the dataset (if
null
, tables don't expire).
- createDecompressingChannel(ReadableByteChannel) - Method in enum org.apache.beam.sdk.io.CompressedSource.CompressionMode
-
Deprecated.
- createDecompressingChannel(ReadableByteChannel) - Method in interface org.apache.beam.sdk.io.CompressedSource.DecompressingChannelFactory
-
Given a channel, create a channel that decompresses the content read from the channel.
- createDefault() - Static method in class org.apache.beam.runners.fnexecution.ServerFactory
-
- createDefault() - Static method in interface org.apache.beam.runners.fnexecution.ServerFactory.UrlFactory
-
- createDefault() - Static method in class org.apache.beam.sdk.coders.CoderRegistry
-
Creates a CoderRegistry containing registrations for all standard coders part of the core Java
Apache Beam SDK and also any registrations provided by
coder
registrars
.
- createDefault() - Static method in class org.apache.beam.sdk.fn.channel.ManagedChannelFactory
-
- createDefault() - Static method in class org.apache.beam.sdk.schemas.SchemaRegistry
-
- createEnvironment(RunnerApi.Environment) - Method in class org.apache.beam.runners.fnexecution.environment.DockerEnvironmentFactory
-
- createEnvironment(RunnerApi.Environment) - Method in interface org.apache.beam.runners.fnexecution.environment.EnvironmentFactory
-
Creates an active RunnerApi.Environment
and returns a handle to it.
- createEnvironment(RunnerApi.Environment) - Method in class org.apache.beam.runners.fnexecution.environment.InProcessEnvironmentFactory
-
- createEpoll() - Static method in class org.apache.beam.sdk.fn.channel.ManagedChannelFactory
-
- createForSubrangeOfFile(String, long, long) - Method in class org.apache.beam.sdk.io.AvroSource
-
- createForSubrangeOfFile(MatchResult.Metadata, long, long) - Method in class org.apache.beam.sdk.io.AvroSource
-
- createForSubrangeOfFile(MatchResult.Metadata, long, long) - Method in class org.apache.beam.sdk.io.BlockBasedSource
-
Creates a BlockBasedSource
for the specified range in a single file.
- createForSubrangeOfFile(MatchResult.Metadata, long, long) - Method in class org.apache.beam.sdk.io.CompressedSource
-
Creates a CompressedSource
for a subrange of a file.
- createForSubrangeOfFile(MatchResult.Metadata, long, long) - Method in class org.apache.beam.sdk.io.FileBasedSource
-
Creates and returns a new FileBasedSource
of the same type as the current FileBasedSource
backed by a given file and an offset range.
- createForSubrangeOfFile(MatchResult.Metadata, long, long) - Method in class org.apache.beam.sdk.io.xml.XmlSource
-
- createFrom(String) - Static method in class org.apache.beam.sdk.fn.channel.SocketAddressFactory
-
Parse a SocketAddress
from the given string.
- CreateGearpumpPCollectionViewTranslator<ElemT,ViewT> - Class in org.apache.beam.runners.gearpump.translators
-
CreateGearpumpPCollectionView bridges input stream to down stream transforms.
- CreateGearpumpPCollectionViewTranslator() - Constructor for class org.apache.beam.runners.gearpump.translators.CreateGearpumpPCollectionViewTranslator
-
- createGetters(Class<?>, Schema) - Method in interface org.apache.beam.sdk.schemas.FieldValueGetterFactory
-
- createGetters(Class<?>, Schema) - Method in class org.apache.beam.sdk.schemas.utils.JavaBeanGetterFactory
-
- createGetters(Class<?>, Schema) - Method in class org.apache.beam.sdk.schemas.utils.PojoValueGetterFactory
-
- createInputFormatInstance() - Method in class org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIO.HadoopInputFormatBoundedSource
-
Creates instance of InputFormat class.
- createJar(File, File) - Static method in class org.apache.beam.runners.apex.ApexYarnLauncher
-
Create a jar file from the given directory.
- createJob(Job) - Method in class org.apache.beam.runners.dataflow.DataflowClient
-
Creates the Dataflow Job
.
- createKinesisProducer(KinesisProducerConfiguration) - Method in interface org.apache.beam.sdk.io.kinesis.AWSClientsProvider
-
- CreateOptions - Class in org.apache.beam.sdk.io.fs
-
An abstract class that contains common configuration options for creating resources.
- CreateOptions() - Constructor for class org.apache.beam.sdk.io.fs.CreateOptions
-
- CreateOptions.Builder<BuilderT extends CreateOptions.Builder<BuilderT>> - Class in org.apache.beam.sdk.io.fs
-
- CreateOptions.StandardCreateOptions - Class in org.apache.beam.sdk.io.fs
-
A standard configuration options with builder.
- CreateOptions.StandardCreateOptions.Builder - Class in org.apache.beam.sdk.io.fs
-
- createPane(boolean, boolean, PaneInfo.Timing) - Static method in class org.apache.beam.sdk.transforms.windowing.PaneInfo
-
- createPane(boolean, boolean, PaneInfo.Timing, long, long) - Static method in class org.apache.beam.sdk.transforms.windowing.PaneInfo
-
Factory method to create a
PaneInfo
with the specified parameters.
- createPipelineOptions(Map<String, String>) - Static method in class org.apache.beam.sdk.extensions.sql.impl.rel.BeamEnumerableConverter
-
- createPrimitiveOutputInternal(Pipeline, WindowingStrategy<?, ?>, PCollection.IsBounded, Coder<T>) - Static method in class org.apache.beam.sdk.values.PCollection
-
For internal use only; no backwards-compatibility guarantees.
- createPrimitiveOutputInternal(Pipeline, WindowingStrategy<?, ?>, PCollection.IsBounded, Coder<T>, TupleTag<?>) - Static method in class org.apache.beam.sdk.values.PCollection
-
For internal use only; no backwards-compatibility guarantees.
- createProcessContext(ValueInSingleWindow<InputT>) - Method in class org.apache.beam.sdk.transforms.DoFnTester
-
- createRandomSubscription(PubsubClient.ProjectPath, PubsubClient.TopicPath, int) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient
-
Create a random subscription for topic
.
- createReader(PipelineOptions) - Method in class org.apache.beam.runners.gearpump.translators.io.BoundedSourceWrapper
-
- createReader(PipelineOptions) - Method in class org.apache.beam.runners.gearpump.translators.io.GearpumpSource
-
- createReader(PipelineOptions) - Method in class org.apache.beam.runners.gearpump.translators.io.UnboundedSourceWrapper
-
- createReader(PipelineOptions, UnboundedSource.CheckpointMark) - Method in class org.apache.beam.runners.gearpump.translators.io.ValuesSource
-
- createReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.BoundedSource
-
- createReader(CassandraIO.CassandraSource<T>) - Method in interface org.apache.beam.sdk.io.cassandra.CassandraService
-
- createReader(CassandraIO.CassandraSource<T>) - Method in class org.apache.beam.sdk.io.cassandra.CassandraServiceImpl
-
- createReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO.BoundedElasticsearchSource
-
- createReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.FileBasedSource
-
- createReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIO.HadoopInputFormatBoundedSource
-
- createReader(PipelineOptions, JmsCheckpointMark) - Method in class org.apache.beam.sdk.io.jms.JmsIO.UnboundedJmsSource
-
- createReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.mongodb.MongoDbGridFSIO.Read.BoundedGridFSSource
-
- createReader(PipelineOptions, CheckpointMarkT) - Method in class org.apache.beam.sdk.io.UnboundedSource
-
- createRunner(ReadyCheckingSideInputReader) - Method in class org.apache.beam.runners.gearpump.translators.utils.DoFnRunnerFactory
-
- createSetters(Class<?>, Schema) - Method in interface org.apache.beam.sdk.schemas.FieldValueSetterFactory
-
- createSetters(Class<?>, Schema) - Method in class org.apache.beam.sdk.schemas.utils.JavaBeanSetterFactory
-
- createSetters(Class<?>, Schema) - Method in class org.apache.beam.sdk.schemas.utils.PojoValueSetterFactory
-
- createSingleFileReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.AvroSource
-
- createSingleFileReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.BlockBasedSource
-
Creates a BlockBasedReader
.
- createSingleFileReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.CompressedSource
-
Creates a FileBasedReader
to read a single file.
- createSingleFileReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.FileBasedSource
-
Creates and returns an instance of a FileBasedReader
implementation for the current
source assuming the source represents a single file.
- createSingleFileReader(PipelineOptions) - Method in class org.apache.beam.sdk.io.xml.XmlSource
-
- createSnsPublisher() - Method in interface org.apache.beam.sdk.io.aws.sns.AwsClientsProvider
-
- createSourceForSubrange(long, long) - Method in class org.apache.beam.sdk.io.FileBasedSource
-
- createSourceForSubrange(long, long) - Method in class org.apache.beam.sdk.io.OffsetBasedSource
-
- CreateStream<T> - Class in org.apache.beam.runners.spark.io
-
Create an input stream from Queue.
- createStreamExecutionEnvironment(FlinkPipelineOptions, List<String>) - Static method in class org.apache.beam.runners.flink.FlinkExecutionEnvironments
-
If the submitted job is a stream processing job, this method creates the adequate Flink StreamExecutionEnvironment
depending on the
user-specified options.
- createStructuralValues(Coder<T>, List<T>) - Static method in class org.apache.beam.sdk.testing.SourceTestUtils
-
Testing utilities below depend on standard assertions and matchers to compare elements read by
sources.
- createSubscription(PubsubClient.TopicPath, PubsubClient.SubscriptionPath, int) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient
-
Create subscription
to topic
.
- createSubscription(PubsubClient.TopicPath, PubsubClient.SubscriptionPath, int) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient
-
- createSubscription(PubsubClient.TopicPath, PubsubClient.SubscriptionPath, int) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient
-
- createTable(Table) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.InMemoryMetaTableProvider
-
- createTable(Table) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.ReadOnlyTableProvider
-
- createTable(Table) - Method in interface org.apache.beam.sdk.extensions.sql.meta.provider.TableProvider
-
Creates a table.
- createTable(Table) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.test.TestTableProvider
-
- createTable(Table) - Method in class org.apache.beam.sdk.extensions.sql.meta.store.InMemoryMetaStore
-
- createTable(Table) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService
-
Creates the specified table if it does not exist.
- CreateTables<DestinationT> - Class in org.apache.beam.sdk.io.gcp.bigquery
-
Creates any tables needed before performing streaming writes to the tables.
- CreateTables(BigQueryIO.Write.CreateDisposition, DynamicDestinations<?, DestinationT>) - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.CreateTables
-
- createTimestampPolicy(TopicPartition, Optional<Instant>) - Method in interface org.apache.beam.sdk.io.kafka.TimestampPolicyFactory
-
Creates a TimestampPolicy for a partition.
- createTopic(PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient
-
Create topic
.
- createTopic(PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient
-
- createTopic(PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient
-
- createTransaction() - Static method in class org.apache.beam.sdk.io.gcp.spanner.SpannerIO
-
Returns a transform that creates a batch transaction.
- CreateTransaction() - Constructor for class org.apache.beam.sdk.io.gcp.spanner.SpannerIO.CreateTransaction
-
- createTranslationContext(JobInfo, List<String>) - Static method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator
-
Creates a batch translation context.
- createTranslationContext(JobInfo, List<String>) - Static method in class org.apache.beam.runners.flink.FlinkStreamingPortablePipelineTranslator
-
Creates a streaming translation context.
- createTranslator() - Static method in class org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator
-
Creates a batch translator.
- createUrl(String, int) - Method in interface org.apache.beam.runners.fnexecution.ServerFactory.UrlFactory
-
- createWithPortSupplier(Supplier<Integer>) - Static method in class org.apache.beam.runners.fnexecution.ServerFactory
-
- createWithUrlFactory(ServerFactory.UrlFactory) - Static method in class org.apache.beam.runners.fnexecution.ServerFactory
-
- createWithUrlFactoryAndPortSupplier(ServerFactory.UrlFactory, Supplier<Integer>) - Static method in class org.apache.beam.runners.fnexecution.ServerFactory
-
Create a
ServerFactory
that uses the given url factory and ports from a supplier.
- createWriteOperation() - Method in class org.apache.beam.sdk.io.FileBasedSink
-
- createWriter(CassandraIO.Write<T>) - Method in interface org.apache.beam.sdk.io.cassandra.CassandraService
-
- createWriter(CassandraIO.Write<T>) - Method in class org.apache.beam.sdk.io.cassandra.CassandraServiceImpl
-
- createWriter() - Method in class org.apache.beam.sdk.io.FileBasedSink.WriteOperation
-
- CredentialFactory - Interface in org.apache.beam.sdk.extensions.gcp.auth
-
Construct an oauth credential to be used by the SDK and the SDK workers.
- csvLines2BeamRows(CSVFormat, String, Schema) - Static method in class org.apache.beam.sdk.extensions.sql.impl.schema.BeamTableUtils
-
Decode zero or more CSV records from the given string, according to the specified
CSVFormat
, and converts them to
Rows
with the specified
Schema
.
- CsvRecorderDecoder(Schema, CSVFormat) - Constructor for class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaCSVTable.CsvRecorderDecoder
-
- CsvRecorderEncoder(Schema, CSVFormat) - Constructor for class org.apache.beam.sdk.extensions.sql.meta.provider.kafka.BeamKafkaCSVTable.CsvRecorderEncoder
-
- CsvSink - Class in org.apache.beam.runners.spark.metrics.sink
-
- CsvSink(Properties, MetricRegistry, SecurityManager) - Constructor for class org.apache.beam.runners.spark.metrics.sink.CsvSink
-
- CsvToRow(Schema, CSVFormat) - Constructor for class org.apache.beam.sdk.extensions.sql.meta.provider.text.TextTableProvider.CsvToRow
-
- ctxt - Variable in class org.apache.beam.runners.spark.SparkRunner.Evaluator
-
- current() - Method in interface org.apache.beam.runners.spark.aggregators.NamedAggregators.State
-
- currentEventTime() - Method in interface org.apache.beam.sdk.state.Timers
-
Returns the current event time.
- currentInputWatermarkTime() - Method in class org.apache.beam.runners.spark.stateful.SparkTimerInternals
-
- currentOutputWatermarkTime() - Method in class org.apache.beam.runners.spark.stateful.SparkTimerInternals
-
- currentProcessingTime() - Method in class org.apache.beam.runners.spark.stateful.SparkTimerInternals
-
- currentProcessingTime() - Method in interface org.apache.beam.sdk.state.Timers
-
Returns the current processing time.
- currentRestriction() - Method in class org.apache.beam.sdk.transforms.splittabledofn.ByteKeyRangeTracker
-
- currentRestriction() - Method in class org.apache.beam.sdk.transforms.splittabledofn.OffsetRangeTracker
-
- currentRestriction() - Method in class org.apache.beam.sdk.transforms.splittabledofn.RestrictionTracker
-
Returns a restriction accurately describing the full range of work the current DoFn.ProcessElement
call will do, including already completed work.
- currentSynchronizedProcessingTime() - Method in class org.apache.beam.runners.spark.stateful.SparkTimerInternals
-
- currentSynchronizedProcessingTime() - Method in interface org.apache.beam.sdk.state.Timers
-
Returns the current synchronized processing time or null
if unknown.
- currentWatermark - Variable in class org.apache.beam.sdk.io.kafka.TimestampPolicyFactory.LogAppendTimePolicy
-
- CUSTOM_SOURCE_FORMAT - Static variable in class org.apache.beam.runners.dataflow.util.PropertyNames
-
- CustomCoder<T> - Class in org.apache.beam.sdk.coders
-
- CustomCoder() - Constructor for class org.apache.beam.sdk.coders.CustomCoder
-
- Customer - Class in org.apache.beam.sdk.extensions.sql.example.model
-
Describes a customer.
- Customer(int, String, String) - Constructor for class org.apache.beam.sdk.extensions.sql.example.model.Customer
-
- Customer() - Constructor for class org.apache.beam.sdk.extensions.sql.example.model.Customer
-
- CustomTimestampPolicyWithLimitedDelay<K,V> - Class in org.apache.beam.sdk.io.kafka
-
A policy for custom record timestamps where timestamps within a partition are expected to be
roughly monotonically increasing with a cap on out of order event delays (say 1 minute).
- CustomTimestampPolicyWithLimitedDelay(SerializableFunction<KafkaRecord<K, V>, Instant>, Duration, Optional<Instant>) - Constructor for class org.apache.beam.sdk.io.kafka.CustomTimestampPolicyWithLimitedDelay
-
A policy for custom record timestamps where timestamps are expected to be roughly monotonically
increasing with out of order event delays less than maxDelay
.
- data(StreamObserver<BeamFnApi.Elements>) - Method in class org.apache.beam.runners.fnexecution.data.GrpcDataService
-
- DataflowClient - Class in org.apache.beam.runners.dataflow
-
Wrapper around the generated Dataflow
client to provide common functionality.
- DataflowClientFactory() - Constructor for class org.apache.beam.runners.dataflow.options.DataflowPipelineDebugOptions.DataflowClientFactory
-
- DataflowJobAlreadyExistsException - Exception in org.apache.beam.runners.dataflow
-
An exception that is thrown if the unique job name constraint of the Dataflow service is broken
because an existing job with the same job name is currently active.
- DataflowJobAlreadyExistsException(DataflowPipelineJob, String) - Constructor for exception org.apache.beam.runners.dataflow.DataflowJobAlreadyExistsException
-
Create a new
DataflowJobAlreadyExistsException
with the specified
DataflowPipelineJob
and message.
- DataflowJobAlreadyUpdatedException - Exception in org.apache.beam.runners.dataflow
-
An exception that is thrown if the existing job has already been updated within the Dataflow
service and is no longer able to be updated.
- DataflowJobAlreadyUpdatedException(DataflowPipelineJob, String) - Constructor for exception org.apache.beam.runners.dataflow.DataflowJobAlreadyUpdatedException
-
Create a new
DataflowJobAlreadyUpdatedException
with the specified
DataflowPipelineJob
and message.
- DataflowJobException - Exception in org.apache.beam.runners.dataflow
-
- DataflowPipelineDebugOptions - Interface in org.apache.beam.runners.dataflow.options
-
Internal.
- DataflowPipelineDebugOptions.DataflowClientFactory - Class in org.apache.beam.runners.dataflow.options
-
Returns the default Dataflow client built from the passed in PipelineOptions.
- DataflowPipelineDebugOptions.StagerFactory - Class in org.apache.beam.runners.dataflow.options
-
- DataflowPipelineJob - Class in org.apache.beam.runners.dataflow
-
A DataflowPipelineJob represents a job submitted to Dataflow using
DataflowRunner
.
- DataflowPipelineJob(DataflowClient, String, DataflowPipelineOptions, Map<AppliedPTransform<?, ?, ?>, String>) - Constructor for class org.apache.beam.runners.dataflow.DataflowPipelineJob
-
Constructs the job.
- DataflowPipelineOptions - Interface in org.apache.beam.runners.dataflow.options
-
- DataflowPipelineOptions.StagingLocationFactory - Class in org.apache.beam.runners.dataflow.options
-
- DataflowPipelineRegistrar - Class in org.apache.beam.runners.dataflow
-
- DataflowPipelineRegistrar.Options - Class in org.apache.beam.runners.dataflow
-
- DataflowPipelineRegistrar.Runner - Class in org.apache.beam.runners.dataflow
-
- DataflowPipelineTranslator - Class in org.apache.beam.runners.dataflow
-
- DataflowPipelineTranslator.JobSpecification - Class in org.apache.beam.runners.dataflow
-
The result of a job translation.
- DataflowPipelineWorkerPoolOptions - Interface in org.apache.beam.runners.dataflow.options
-
Options that are used to configure the Dataflow pipeline worker pool.
- DataflowPipelineWorkerPoolOptions.AutoscalingAlgorithmType - Enum in org.apache.beam.runners.dataflow.options
-
Type of autoscaling algorithm to use.
- DataflowPipelineWorkerPoolOptions.WorkerHarnessContainerImageFactory - Class in org.apache.beam.runners.dataflow.options
-
Returns the default Docker container image that executes Dataflow worker harness, residing in
Google Container Registry.
- DataflowProfilingAgentConfiguration() - Constructor for class org.apache.beam.runners.dataflow.options.DataflowProfilingOptions.DataflowProfilingAgentConfiguration
-
- DataflowProfilingOptions - Interface in org.apache.beam.runners.dataflow.options
-
Options for controlling profiling of pipeline execution.
- DataflowProfilingOptions.DataflowProfilingAgentConfiguration - Class in org.apache.beam.runners.dataflow.options
-
Configuration the for profiling agent.
- DataflowRunner - Class in org.apache.beam.runners.dataflow
-
A
PipelineRunner
that executes the operations in the pipeline by first translating them
to the Dataflow representation using the
DataflowPipelineTranslator
and then submitting
them to a Dataflow service for execution.
- DataflowRunner(DataflowPipelineOptions) - Constructor for class org.apache.beam.runners.dataflow.DataflowRunner
-
- DataflowRunner.StreamingPCollectionViewWriterFn<T> - Class in org.apache.beam.runners.dataflow
-
- DataflowRunnerHooks - Class in org.apache.beam.runners.dataflow
-
An instance of this class can be passed to the
DataflowRunner
to add user defined hooks
to be invoked at various times during pipeline execution.
- DataflowRunnerHooks() - Constructor for class org.apache.beam.runners.dataflow.DataflowRunnerHooks
-
- DataflowRunnerInfo - Class in org.apache.beam.runners.dataflow
-
- DataflowServiceException - Exception in org.apache.beam.runners.dataflow
-
Signals there was an error retrieving information about a job from the Cloud Dataflow Service.
- DataflowTemplateJob - Class in org.apache.beam.runners.dataflow.util
-
- DataflowTemplateJob() - Constructor for class org.apache.beam.runners.dataflow.util.DataflowTemplateJob
-
- DataflowTransport - Class in org.apache.beam.runners.dataflow.util
-
Helpers for cloud communication.
- DataflowTransport() - Constructor for class org.apache.beam.runners.dataflow.util.DataflowTransport
-
- DataflowWorkerHarnessOptions - Interface in org.apache.beam.runners.dataflow.options
-
Options that are used exclusively within the Dataflow worker harness.
- DataflowWorkerLoggingOptions - Interface in org.apache.beam.runners.dataflow.options
-
- DataflowWorkerLoggingOptions.Level - Enum in org.apache.beam.runners.dataflow.options
-
Deprecated.
The set of log levels that can be used on the Dataflow worker.
- DataflowWorkerLoggingOptions.WorkerLogLevelOverrides - Class in org.apache.beam.runners.dataflow.options
-
Deprecated.
Defines a log level override for a specific class, package, or name.
- DataSourceConfiguration() - Constructor for class org.apache.beam.sdk.io.jdbc.JdbcIO.DataSourceConfiguration
-
- DatastoreIO - Class in org.apache.beam.sdk.io.gcp.datastore
-
- DatastoreV1 - Class in org.apache.beam.sdk.io.gcp.datastore
-
- DatastoreV1.DeleteEntity - Class in org.apache.beam.sdk.io.gcp.datastore
-
A
PTransform
that deletes
Entities
from Cloud Datastore.
- DatastoreV1.DeleteKey - Class in org.apache.beam.sdk.io.gcp.datastore
-
A
PTransform
that deletes
Entities
associated with the given
Keys
from Cloud Datastore.
- DatastoreV1.Read - Class in org.apache.beam.sdk.io.gcp.datastore
-
A
PTransform
that reads the result rows of a Cloud Datastore query as
Entity
objects.
- DatastoreV1.Write - Class in org.apache.beam.sdk.io.gcp.datastore
-
A
PTransform
that writes
Entity
objects to Cloud Datastore.
- DataStreamDecoder(Coder<T>, InputStream) - Constructor for class org.apache.beam.sdk.fn.stream.DataStreams.DataStreamDecoder
-
- DataStreams - Class in org.apache.beam.sdk.fn.stream
-
- DataStreams() - Constructor for class org.apache.beam.sdk.fn.stream.DataStreams
-
- DataStreams.BlockingQueueIterator<T> - Class in org.apache.beam.sdk.fn.stream
-
Allows for one or more writing threads to append values to this iterator while one reading
thread reads values.
- DataStreams.DataStreamDecoder<T> - Class in org.apache.beam.sdk.fn.stream
-
An adapter which converts an
InputStream
to an
Iterator
of
T
values
using the specified
Coder
.
- DataStreams.ElementDelimitedOutputStream - Class in org.apache.beam.sdk.fn.stream
-
- DataStreams.OutputChunkConsumer<T> - Interface in org.apache.beam.sdk.fn.stream
-
- DATE - Static variable in class org.apache.beam.sdk.extensions.sql.impl.utils.CalciteUtils
-
- DATE_TYPES - Static variable in enum org.apache.beam.sdk.schemas.Schema.TypeName
-
- DATE_TYPES_TO_BIGINT - Static variable in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret.DatetimeReinterpretConversions
-
- DateOperators - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator
-
Date operator implementations.
- DateOperators() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.DateOperators
-
- DATETIME - Static variable in class org.apache.beam.sdk.schemas.Schema.FieldType
-
The type of datetime fields.
- DATETIME_CEIL - Static variable in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.DateOperators
-
Implementation of CEIL(date or time TO unit).
- DATETIME_FLOOR - Static variable in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.DateOperators
-
Implementation of FLOOR(date or time TO unit).
- DatetimeReinterpretConversions - Class in org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret
-
Utility class to contain implementations of datetime SQL type conversions.
- DatetimeReinterpretConversions() - Constructor for class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.reinterpret.DatetimeReinterpretConversions
-
- days(int) - Static method in class org.apache.beam.sdk.transforms.windowing.CalendarWindows
-
Returns a
WindowFn
that windows elements into periods measured by days.
- dec() - Method in interface org.apache.beam.sdk.metrics.Counter
-
- dec(long) - Method in interface org.apache.beam.sdk.metrics.Counter
-
- DECIMAL - Static variable in class org.apache.beam.sdk.extensions.sql.impl.utils.CalciteUtils
-
- DECIMAL - Static variable in class org.apache.beam.sdk.schemas.Schema.FieldType
-
The type of decimal fields.
- decode(InputStream) - Method in class org.apache.beam.runners.dataflow.util.RandomAccessData.RandomAccessDataCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.runners.dataflow.util.RandomAccessData.RandomAccessDataCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.AvroCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.BigDecimalCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.BigDecimalCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.BigEndianIntegerCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.BigEndianLongCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.BigEndianShortCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.BigIntegerCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.BigIntegerCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.BitSetCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.BitSetCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.BooleanCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.ByteArrayCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.ByteArrayCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.ByteCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.Coder
-
Decodes a value of type T
from the given input stream in the given context.
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.Coder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.DelegateCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.DelegateCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.DoubleCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.DurationCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.FloatCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.InstantCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.IterableLikeCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.KvCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.KvCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.LengthPrefixCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.MapCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.MapCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.NullableCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.NullableCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.RowCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.SerializableCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.ShardedKeyCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.SnappyCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.StringDelegateCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.StringDelegateCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.StringUtf8Coder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.StringUtf8Coder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.TextualIntegerCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.coders.TextualIntegerCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.VarIntCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.VarLongCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.coders.VoidCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.extensions.protobuf.ByteStringCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.extensions.protobuf.ByteStringCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.extensions.protobuf.ProtoCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.extensions.protobuf.ProtoCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.extensions.sketching.ApproximateDistinct.HyperLogLogPlusCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.extensions.sql.impl.transform.BeamAggregationTransforms.AggregationAccumulatorCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.fn.windowing.EncodedBoundedWindow.Coder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.amqp.AmqpMessageCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.aws.sns.PublishResultCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.DefaultFilenamePolicy.ParamsCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.FileBasedSink.FileResultCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.fs.MetadataCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.fs.ResourceIdCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.gcp.bigquery.BigQueryInsertErrorCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestinationCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableDestinationCoderV2
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableRowJsonCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.io.gcp.bigquery.TableRowJsonCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessagePayloadOnlyCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessagePayloadOnlyCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessageWithAttributesCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubMessageWithAttributesCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.hadoop.WritableCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.kafka.KafkaRecordCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.ReadableFileCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.io.xml.JAXBCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.io.xml.JAXBCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.schemas.SchemaCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.transforms.join.CoGbkResult.CoGbkResultCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.transforms.join.UnionCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.transforms.join.UnionCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.transforms.windowing.GlobalWindow.Coder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.transforms.windowing.IntervalWindow.IntervalWindowCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.transforms.windowing.PaneInfo.PaneInfoCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.values.TimestampedValue.TimestampedValueCoder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.values.ValueInSingleWindow.Coder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.values.ValueInSingleWindow.Coder
-
- decode(InputStream) - Method in class org.apache.beam.sdk.values.ValueWithRecordId.ValueWithRecordIdCoder
-
- decode(InputStream, Coder.Context) - Method in class org.apache.beam.sdk.values.ValueWithRecordId.ValueWithRecordIdCoder
-
- decodePane(byte) - Static method in class org.apache.beam.sdk.transforms.windowing.PaneInfo
-
- decodeToIterable(List<T>) - Method in class org.apache.beam.sdk.coders.CollectionCoder
-
Builds an instance of IterableT
, this coder's associated Iterable
-like subtype,
from a list of decoded elements.
- decodeToIterable(List<T>) - Method in class org.apache.beam.sdk.coders.IterableCoder
-
- decodeToIterable(List<T>) - Method in class org.apache.beam.sdk.coders.IterableLikeCoder
-
Builds an instance of IterableT
, this coder's associated Iterable
-like subtype,
from a list of decoded elements.
- decodeToIterable(List<T>) - Method in class org.apache.beam.sdk.coders.ListCoder
-
- decodeToIterable(List<T>) - Method in class org.apache.beam.sdk.coders.SetCoder
-
Builds an instance of IterableT
, this coder's associated Iterable
-like subtype,
from a list of decoded elements.
- decrementingLongs() - Static method in class org.apache.beam.sdk.fn.IdGenerators
-
Returns an
IdGenerators
that will provide successive decrementing longs.
- deduceOutputType(SqlTypeName, SqlTypeName) - Static method in class org.apache.beam.sdk.extensions.sql.impl.interpreter.operator.arithmetic.BeamSqlArithmeticExpression
-
- Default - Annotation Type in org.apache.beam.sdk.options
-
Default
represents a set of annotations that can be used to annotate getter properties on
PipelineOptions
with information representing the default value to be returned if no
value is specified.
- Default.Boolean - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified boolean primitive value.
- Default.Byte - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified byte primitive value.
- Default.Character - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified char primitive value.
- Default.Class - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified Class
value.
- Default.Double - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified double primitive value.
- Default.Enum - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified enum.
- Default.Float - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified float primitive value.
- Default.InstanceFactory - Annotation Type in org.apache.beam.sdk.options
-
- Default.Integer - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified int primitive value.
- Default.Long - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified long primitive value.
- Default.Short - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified short primitive value.
- Default.String - Annotation Type in org.apache.beam.sdk.options
-
This represents that the default of the option is the specified String
value.
- DEFAULT_BYTE_ARRAY_CODER - Static variable in class org.apache.beam.sdk.io.TFRecordIO
-
The default coder, which returns each record of the input file as a byte array.
- DEFAULT_MAX_NUM_ELEMENTS - Static variable in class org.apache.beam.sdk.transforms.ApproximateQuantiles.ApproximateQuantilesCombineFn
-
The cost (in time and space) to compute quantiles to a given accuracy is a function of the
total number of elements in the data set.
- DEFAULT_OUTBOUND_BUFFER_LIMIT_BYTES - Static variable in class org.apache.beam.sdk.fn.stream.DataStreams
-
- DEFAULT_SCHEME - Static variable in class org.apache.beam.sdk.io.FileSystems
-
- DEFAULT_UNWINDOWED_SHARD_TEMPLATE - Static variable in class org.apache.beam.sdk.io.DefaultFilenamePolicy
-
The default sharding name template.
- DEFAULT_WINDOWED_SHARD_TEMPLATE - Static variable in class org.apache.beam.sdk.io.DefaultFilenamePolicy
-
The default windowed sharding name template used when writing windowed files.
- DefaultCoder - Annotation Type in org.apache.beam.sdk.coders
-
The
DefaultCoder
annotation specifies a
Coder
class to handle encoding and
decoding instances of the annotated class.
- DefaultCoder.DefaultCoderProviderRegistrar - Class in org.apache.beam.sdk.coders
-
- DefaultCoderCloudObjectTranslatorRegistrar - Class in org.apache.beam.runners.dataflow.util
-
- DefaultCoderCloudObjectTranslatorRegistrar() - Constructor for class org.apache.beam.runners.dataflow.util.DefaultCoderCloudObjectTranslatorRegistrar
-
- DefaultCoderProviderRegistrar() - Constructor for class org.apache.beam.sdk.coders.DefaultCoder.DefaultCoderProviderRegistrar
-
- DefaultConcludeTransform() - Constructor for class org.apache.beam.sdk.testing.PAssert.DefaultConcludeTransform
-
- DefaultFilenamePolicy - Class in org.apache.beam.sdk.io
-
- DefaultFilenamePolicy.Params - Class in org.apache.beam.sdk.io
-
- DefaultFilenamePolicy.ParamsCoder - Class in org.apache.beam.sdk.io
-
- DefaultJobServerConfigFactory() - Constructor for class org.apache.beam.runners.reference.testing.TestPortablePipelineOptions.DefaultJobServerConfigFactory
-
- defaultNaming(String, String) - Static method in class org.apache.beam.sdk.io.FileIO.Write
-
- defaultNaming(ValueProvider<String>, ValueProvider<String>) - Static method in class org.apache.beam.sdk.io.FileIO.Write
-
- DefaultParallelismFactory - Class in org.apache.beam.runners.flink
-
- DefaultParallelismFactory() - Constructor for class org.apache.beam.runners.flink.DefaultParallelismFactory
-
- DefaultPipelineOptionsRegistrar - Class in org.apache.beam.sdk.options
-
- DefaultPipelineOptionsRegistrar() - Constructor for class org.apache.beam.sdk.options.DefaultPipelineOptionsRegistrar
-
- DefaultProjectFactory() - Constructor for class org.apache.beam.sdk.extensions.gcp.options.GcpOptions.DefaultProjectFactory
-
- DefaultRetryStrategy() - Constructor for class org.apache.beam.sdk.io.jdbc.JdbcIO.DefaultRetryStrategy
-
- Defaults() - Constructor for class org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults
-
- DefaultSchema - Annotation Type in org.apache.beam.sdk.schemas
-
- DefaultSchema.DefaultSchemaProvider - Class in org.apache.beam.sdk.schemas
-
- DefaultSchema.DefaultSchemaProviderRegistrar - Class in org.apache.beam.sdk.schemas
-
Registrar for default schemas.
- DefaultSchemaProvider() - Constructor for class org.apache.beam.sdk.schemas.DefaultSchema.DefaultSchemaProvider
-
- DefaultSchemaProviderRegistrar() - Constructor for class org.apache.beam.sdk.schemas.DefaultSchema.DefaultSchemaProviderRegistrar
-
- DefaultStopPipelineWatermarkFactory() - Constructor for class org.apache.beam.runners.spark.TestSparkPipelineOptions.DefaultStopPipelineWatermarkFactory
-
- DefaultTrigger - Class in org.apache.beam.sdk.transforms.windowing
-
A trigger that is equivalent to Repeatedly.forever(AfterWatermark.pastEndOfWindow())
.
- defaultValue() - Method in class org.apache.beam.sdk.transforms.Combine.CombineFn
-
Returns the default value when there are no values added to the accumulator.
- defaultValue() - Method in interface org.apache.beam.sdk.transforms.CombineFnBase.GlobalCombineFn
-
Returns the default value when there are no values added to the accumulator.
- defaultValue() - Method in class org.apache.beam.sdk.transforms.CombineWithContext.CombineFnWithContext
-
- defaultValue() - Method in class org.apache.beam.sdk.transforms.View.AsSingleton
-
Returns the default value of this transform, or null if there isn't one.
- DefaultValueFactory<T> - Interface in org.apache.beam.sdk.options
-
- delay(Duration) - Static method in class org.apache.beam.sdk.transforms.windowing.TimestampTransform
-
For internal use only; no backwards-compatibility guarantees.
- Delay() - Constructor for class org.apache.beam.sdk.transforms.windowing.TimestampTransform.Delay
-
- delegate() - Method in class org.apache.beam.runners.dataflow.PrimitiveParDoSingleFactory.ParDoSingle
-
- delegate(HasDisplayData) - Method in interface org.apache.beam.sdk.transforms.display.DisplayData.Builder
-
Register display data from the specified component on behalf of the current component.
- delegateBasedUponType(EnumMap<BeamFnApi.StateKey.TypeCase, StateRequestHandler>) - Static method in class org.apache.beam.runners.fnexecution.state.StateRequestHandlers
-
Returns a
StateRequestHandler
which delegates to the supplied handler depending on the
BeamFnApi.StateRequest
s
type
.
- DelegateCoder<T,IntermediateT> - Class in org.apache.beam.sdk.coders
-
A
DelegateCoder<T, IntermediateT>
wraps a
Coder
for
IntermediateT
and
encodes/decodes values of type
T
by converting to/from
IntermediateT
and then
encoding/decoding using the underlying
Coder<IntermediateT>
.
- DelegateCoder(Coder<IntermediateT>, DelegateCoder.CodingFunction<T, IntermediateT>, DelegateCoder.CodingFunction<IntermediateT, T>, TypeDescriptor<T>) - Constructor for class org.apache.beam.sdk.coders.DelegateCoder
-
- DelegateCoder.CodingFunction<InputT,OutputT> - Interface in org.apache.beam.sdk.coders
-
- delete(Collection<ResourceIdT>) - Method in class org.apache.beam.sdk.io.FileSystem
-
Deletes a collection of resources.
- delete(Collection<ResourceId>, MoveOptions...) - Static method in class org.apache.beam.sdk.io.FileSystems
-
Deletes a collection of resources.
- deleteDataset(String, String) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService
-
Deletes the dataset specified by the datasetId value.
- deletedTimer(TimerInternals.TimerData) - Method in class org.apache.beam.runners.direct.WatermarkManager.TimerUpdate.TimerUpdateBuilder
-
Adds the provided timer to the collection of deleted timers, removing it from set timers if
it has previously been set.
- deleteEntity() - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1
-
- deleteKey() - Method in class org.apache.beam.sdk.io.gcp.datastore.DatastoreV1
-
- deleteSubscription(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient
-
Delete subscription
.
- deleteSubscription(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient
-
- deleteSubscription(PubsubClient.SubscriptionPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient
-
- deleteTable(TableReference) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.DatasetService
-
Deletes the table specified by tableId from the dataset.
- deleteTimer(StateNamespace, String, TimeDomain) - Method in class org.apache.beam.runners.spark.stateful.SparkTimerInternals
-
- deleteTimer(TimerInternals.TimerData) - Method in class org.apache.beam.runners.spark.stateful.SparkTimerInternals
-
- deleteTimer(StateNamespace, String) - Method in class org.apache.beam.runners.spark.stateful.SparkTimerInternals
-
- deleteTimer(Instant, TimeDomain) - Method in interface org.apache.beam.sdk.state.Timers
-
Removes the timer set in this context for the timestmap
and timeDomain
.
- deleteTopic(PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient
-
- deleteTopic(PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient
-
- deleteTopic(PubsubClient.TopicPath) - Method in class org.apache.beam.sdk.io.gcp.pubsub.PubsubJsonClient
-
- delimitElement() - Method in class org.apache.beam.sdk.fn.stream.DataStreams.ElementDelimitedOutputStream
-
- dependsOnlyOnEarliestTimestamp() - Method in enum org.apache.beam.sdk.transforms.windowing.TimestampCombiner
-
Returns true
if the result of combination of many output timestamps actually depends
only on the earliest.
- dependsOnlyOnWindow() - Method in enum org.apache.beam.sdk.transforms.windowing.TimestampCombiner
-
Returns true
if the result does not depend on what outputs were combined but only the
window they are in.
- deregister() - Method in interface org.apache.beam.runners.fnexecution.state.StateDelegator.Registration
-
De-registers the handler for all future requests for state for the registered process bundle
instruction id.
- describeMismatchSafely(PipelineResult, Description) - Method in class org.apache.beam.sdk.testing.FileChecksumMatcher
-
- describeTo(Description) - Method in class org.apache.beam.sdk.testing.FileChecksumMatcher
-
- describeTo(Description) - Method in class org.apache.beam.sdk.testing.RegexMatcher
-
- describeTo(Description) - Method in class org.apache.beam.sdk.testing.TestPipelineOptions.AlwaysPassMatcher
-
- Description - Annotation Type in org.apache.beam.sdk.options
-
Descriptions are used to generate human readable output when the --help
command is
specified.
- deserialize(String, byte[]) - Method in class org.apache.beam.sdk.io.kafka.serialization.InstantDeserializer
-
- deserialize(JsonParser, DeserializationContext) - Method in class org.apache.beam.sdk.options.ValueProvider.Deserializer
-
- deserializeTimers(Collection<byte[]>, TimerInternals.TimerDataCoder) - Static method in class org.apache.beam.runners.spark.stateful.SparkTimerInternals
-
- detect(String) - Static method in enum org.apache.beam.sdk.io.Compression
-
- DirectOptions - Interface in org.apache.beam.runners.direct
-
- DirectOptions.AvailableParallelismFactory - Class in org.apache.beam.runners.direct
-
- DIRECTORY_CONTAINER - Static variable in class org.apache.beam.sdk.io.ShardNameTemplate
-
Shard is a file within a directory.
- DirectRegistrar - Class in org.apache.beam.runners.direct
-
- DirectRegistrar.Options - Class in org.apache.beam.runners.direct
-
- DirectRegistrar.Runner - Class in org.apache.beam.runners.direct
-
- DirectRunner - Class in org.apache.beam.runners.direct
-
- DirectRunner() - Constructor for class org.apache.beam.sdk.options.PipelineOptions.DirectRunner
-
- DirectRunner.DirectPipelineResult - Class in org.apache.beam.runners.direct
-
- DirectStreamObserver<T> - Class in org.apache.beam.sdk.fn.stream
-
A StreamObserver
which uses synchronization on the underlying CallStreamObserver
to provide thread safety.
- DirectStreamObserver(Phaser, CallStreamObserver<T>) - Constructor for class org.apache.beam.sdk.fn.stream.DirectStreamObserver
-
- DirectTestOptions - Interface in org.apache.beam.runners.direct
-
Internal-only options for tweaking the behavior of the
DirectRunner
in ways that users
should never do.
- DISALLOW_COMBINER_LIFTING - Static variable in class org.apache.beam.runners.dataflow.util.PropertyNames
-
- discardingFiredPanes() - Method in class org.apache.beam.sdk.transforms.windowing.Window
-
Returns a new Window
PTransform
that uses the registered WindowFn and
Triggering behavior, and that discards elements in a pane after they are triggered.
- dispatchBag(Coder<?>) - Method in interface org.apache.beam.sdk.state.StateSpec.Cases
-
- dispatchBag(Coder<?>) - Method in class org.apache.beam.sdk.state.StateSpec.Cases.WithDefault
-
- dispatchCombining(Combine.CombineFn<?, ?, ?>, Coder<?>) - Method in interface org.apache.beam.sdk.state.StateSpec.Cases
-
- dispatchCombining(Combine.CombineFn<?, ?, ?>, Coder<?>) - Method in class org.apache.beam.sdk.state.StateSpec.Cases.WithDefault
-
- dispatchDefault() - Method in class org.apache.beam.sdk.state.StateSpec.Cases.WithDefault
-
- dispatchMap(Coder<?>, Coder<?>) - Method in interface org.apache.beam.sdk.state.StateSpec.Cases
-
- dispatchMap(Coder<?>, Coder<?>) - Method in class org.apache.beam.sdk.state.StateSpec.Cases.WithDefault
-
- dispatchSet(Coder<?>) - Method in interface org.apache.beam.sdk.state.StateSpec.Cases
-
- dispatchSet(Coder<?>) - Method in class org.apache.beam.sdk.state.StateSpec.Cases.WithDefault
-
- dispatchValue(Coder<?>) - Method in interface org.apache.beam.sdk.state.StateSpec.Cases
-
- dispatchValue(Coder<?>) - Method in class org.apache.beam.sdk.state.StateSpec.Cases.WithDefault
-
- DISPLAY_DATA - Static variable in class org.apache.beam.runners.dataflow.util.PropertyNames
-
- DisplayData - Class in org.apache.beam.sdk.transforms.display
-
Static display data associated with a pipeline component.
- DisplayData.Builder - Interface in org.apache.beam.sdk.transforms.display
-
Utility to build up display data from a component and its included subcomponents.
- DisplayData.Identifier - Class in org.apache.beam.sdk.transforms.display
-
Unique identifier for a display data item within a component.
- DisplayData.Item - Class in org.apache.beam.sdk.transforms.display
-
Items
are the unit of display data.
- DisplayData.ItemSpec<T> - Class in org.apache.beam.sdk.transforms.display
-
- DisplayData.Path - Class in org.apache.beam.sdk.transforms.display
-
Structured path of registered display data within a component hierarchy.
- DisplayData.Type - Enum in org.apache.beam.sdk.transforms.display
-
Display data type.
- Distinct<T> - Class in org.apache.beam.sdk.transforms
-
Distinct<T>
takes a PCollection<T>
and returns a PCollection<T>
that has
all distinct elements of the input.
- Distinct() - Constructor for class org.apache.beam.sdk.transforms.Distinct
-
- Distinct.WithRepresentativeValues<T,IdT> - Class in org.apache.beam.sdk.transforms
-
- Distribution - Interface in org.apache.beam.sdk.metrics
-
A metric that reports information about the distribution of reported values.
- distribution(String, String) - Static method in class org.apache.beam.sdk.metrics.Metrics
-
Create a metric that records various statistics about the distribution of reported values.
- distribution(Class<?>, String) - Static method in class org.apache.beam.sdk.metrics.Metrics
-
Create a metric that records various statistics about the distribution of reported values.
- DistributionResult - Class in org.apache.beam.sdk.metrics
-
- DistributionResult() - Constructor for class org.apache.beam.sdk.metrics.DistributionResult
-
- doChecks(PAssert.PAssertionSite, ActualT, SerializableFunction<ActualT, Void>) - Static method in class org.apache.beam.sdk.testing.PAssert
-
- DockerEnvironmentFactory - Class in org.apache.beam.runners.fnexecution.environment
-
- DockerJobBundleFactory - Class in org.apache.beam.runners.fnexecution.control
-
- DockerJobBundleFactory(JobInfo) - Constructor for class org.apache.beam.runners.fnexecution.control.DockerJobBundleFactory
-
- DockerJobBundleFactory.JobBundleFactoryFactory - Interface in org.apache.beam.runners.fnexecution.control
-
- DoFn<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
The argument to
ParDo
providing the code to use to process elements of the input
PCollection
.
- DoFn() - Constructor for class org.apache.beam.sdk.transforms.DoFn
-
- DoFn.BoundedPerElement - Annotation Type in org.apache.beam.sdk.transforms
-
- DoFn.Element - Annotation Type in org.apache.beam.sdk.transforms
-
- DoFn.FieldAccess - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for specifying specific fields that are accessed in a Schema PCollection.
- DoFn.FinishBundle - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for the method to use to finish processing a batch of elements.
- DoFn.FinishBundleContext - Class in org.apache.beam.sdk.transforms
-
- DoFn.GetInitialRestriction - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for the method that maps an element to an initial restriction for a
splittable DoFn
.
- DoFn.GetRestrictionCoder - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for the method that returns the coder to use for the restriction of a
splittable DoFn
.
- DoFn.MultiOutputReceiver - Interface in org.apache.beam.sdk.transforms
-
Receives tagged output for a multi-output function.
- DoFn.NewTracker - Annotation Type in org.apache.beam.sdk.transforms
-
- DoFn.OnTimer - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for registering a callback for a timer.
- DoFn.OnTimerContext - Class in org.apache.beam.sdk.transforms
-
- DoFn.OnWindowExpiration - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for the method to use for performing actions on window expiration.
- DoFn.OutputReceiver<T> - Interface in org.apache.beam.sdk.transforms
-
Receives values of the given type.
- DoFn.ProcessContext - Class in org.apache.beam.sdk.transforms
-
- DoFn.ProcessContinuation - Class in org.apache.beam.sdk.transforms
-
When used as a return value of
DoFn.ProcessElement
, indicates whether there is more work to
be done for the current element.
- DoFn.ProcessElement - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for the method to use for processing elements.
- DoFn.RequiresStableInput - Annotation Type in org.apache.beam.sdk.transforms
-
Experimental - no backwards compatibility guarantees.
- DoFn.Setup - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for the method to use to prepare an instance for processing bundles of elements.
- DoFn.SplitRestriction - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for the method that splits restriction of a
splittable DoFn
into multiple parts to
be processed in parallel.
- DoFn.StartBundle - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for the method to use to prepare an instance for processing a batch of elements.
- DoFn.StartBundleContext - Class in org.apache.beam.sdk.transforms
-
- DoFn.StateId - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for declaring and dereferencing state cells.
- DoFn.Teardown - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for the method to use to clean up this instance before it is discarded.
- DoFn.TimerId - Annotation Type in org.apache.beam.sdk.transforms
-
Annotation for declaring and dereferencing timers.
- DoFn.Timestamp - Annotation Type in org.apache.beam.sdk.transforms
-
- DoFn.UnboundedPerElement - Annotation Type in org.apache.beam.sdk.transforms
-
- DoFn.WindowedContext - Class in org.apache.beam.sdk.transforms
-
Information accessible to all methods in this
DoFn
where the context is in some window.
- DoFnFunction<InputT,OutputT> - Class in org.apache.beam.runners.gearpump.translators.functions
-
Gearpump
FlatMapFunction
wrapper over Beam
DoFn
.
- DoFnFunction(GearpumpPipelineOptions, DoFn<InputT, OutputT>, WindowingStrategy<?, ?>, Collection<PCollectionView<?>>, Map<String, PCollectionView<?>>, TupleTag<OutputT>, Map<TupleTag<?>, Coder<?>>, List<TupleTag<?>>) - Constructor for class org.apache.beam.runners.gearpump.translators.functions.DoFnFunction
-
- DoFnOutputReceivers - Class in org.apache.beam.sdk.transforms
-
- DoFnOutputReceivers() - Constructor for class org.apache.beam.sdk.transforms.DoFnOutputReceivers
-
- DoFnRunnerFactory<InputT,OutputT> - Class in org.apache.beam.runners.gearpump.translators.utils
-
a serializable SimpleDoFnRunner
.
- DoFnRunnerFactory(GearpumpPipelineOptions, DoFn<InputT, OutputT>, Collection<PCollectionView<?>>, DoFnRunners.OutputManager, TupleTag<OutputT>, List<TupleTag<?>>, StepContext, Map<TupleTag<?>, Coder<?>>, WindowingStrategy<?, ?>) - Constructor for class org.apache.beam.runners.gearpump.translators.utils.DoFnRunnerFactory
-
- DoFnRunnerWithMetricsUpdate<InputT,OutputT> - Class in org.apache.beam.runners.flink.metrics
-
DoFnRunner
decorator which registers MetricsContainerImpl
.
- DoFnRunnerWithMetricsUpdate(String, DoFnRunner<InputT, OutputT>, RuntimeContext) - Constructor for class org.apache.beam.runners.flink.metrics.DoFnRunnerWithMetricsUpdate
-
- DoFnTester<InputT,OutputT> - Class in org.apache.beam.sdk.transforms
-
- DoFnTester.CloningBehavior - Enum in org.apache.beam.sdk.transforms
-
- DOUBLE - Static variable in class org.apache.beam.sdk.extensions.sql.impl.utils.CalciteUtils
-
- DOUBLE - Static variable in class org.apache.beam.sdk.schemas.Schema.FieldType
-
The type of double fields.
- DoubleCoder - Class in org.apache.beam.sdk.coders
-
A
DoubleCoder
encodes
Double
values in 8 bytes using Java serialization.
- doubles() - Static method in class org.apache.beam.sdk.values.TypeDescriptors
-
- doublesGlobally() - Static method in class org.apache.beam.sdk.transforms.Max
-
Returns a PTransform
that takes an input PCollection<Double>
and returns a
PCollection<Double>
whose contents is the maximum of the input PCollection
's
elements, or Double.NEGATIVE_INFINITY
if there are no elements.
- doublesGlobally() - Static method in class org.apache.beam.sdk.transforms.Min
-
Returns a PTransform
that takes an input PCollection<Double>
and returns a
PCollection<Double>
whose contents is the minimum of the input PCollection
's
elements, or Double.POSITIVE_INFINITY
if there are no elements.
- doublesGlobally() - Static method in class org.apache.beam.sdk.transforms.Sum
-
Returns a PTransform
that takes an input PCollection<Double>
and returns a
PCollection<Double>
whose contents is the sum of the input PCollection
's
elements, or 0
if there are no elements.
- doublesPerKey() - Static method in class org.apache.beam.sdk.transforms.Max
-
Returns a PTransform
that takes an input PCollection<KV<K, Double>>
and returns
a PCollection<KV<K, Double>>
that contains an output element mapping each distinct key
in the input PCollection
to the maximum of the values associated with that key in the
input PCollection
.
- doublesPerKey() - Static method in class org.apache.beam.sdk.transforms.Min
-
Returns a PTransform
that takes an input PCollection<KV<K, Double>>
and returns
a PCollection<KV<K, Double>>
that contains an output element mapping each distinct key
in the input PCollection
to the minimum of the values associated with that key in the
input PCollection
.
- doublesPerKey() - Static method in class org.apache.beam.sdk.transforms.Sum
-
Returns a PTransform
that takes an input PCollection<KV<K, Double>>
and returns
a PCollection<KV<K, Double>>
that contains an output element mapping each distinct key
in the input PCollection
to the sum of the values associated with that key in the input
PCollection
.
- drive() - Method in interface org.apache.beam.runners.local.ExecutionDriver
-
- dropTable(SqlParserPos, boolean, SqlIdentifier) - Static method in class org.apache.beam.sdk.extensions.sql.impl.parser.SqlDdlNodes
-
Creates a DROP TABLE.
- dropTable(String) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.InMemoryMetaTableProvider
-
- dropTable(String) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.ReadOnlyTableProvider
-
- dropTable(String) - Method in interface org.apache.beam.sdk.extensions.sql.meta.provider.TableProvider
-
Drops a table.
- dropTable(String) - Method in class org.apache.beam.sdk.extensions.sql.meta.provider.test.TestTableProvider
-
- dropTable(String) - Method in class org.apache.beam.sdk.extensions.sql.meta.store.InMemoryMetaStore
-
- dryRunQuery(String, JobConfigurationQuery, String) - Method in interface org.apache.beam.sdk.io.gcp.bigquery.BigQueryServices.JobService
-
Dry runs the query in the given project.
- DurationCoder - Class in org.apache.beam.sdk.coders
-
- DynamicAvroDestinations<UserT,DestinationT,OutputT> - Class in org.apache.beam.sdk.io
-
- DynamicAvroDestinations() - Constructor for class org.apache.beam.sdk.io.DynamicAvroDestinations
-
- DynamicDestinations() - Constructor for class org.apache.beam.sdk.io.FileBasedSink.DynamicDestinations
-
- DynamicDestinations<T,DestinationT> - Class in org.apache.beam.sdk.io.gcp.bigquery
-
This class provides the most general way of specifying dynamic BigQuery table destinations.
- DynamicDestinations() - Constructor for class org.apache.beam.sdk.io.gcp.bigquery.DynamicDestinations
-
- DynamicFileDestinations - Class in org.apache.beam.sdk.io
-
- DynamicFileDestinations() - Constructor for class org.apache.beam.sdk.io.DynamicFileDestinations
-