InputT
- the type of inputAccumT
- the type of accumulatorOutputT
- the type of outputpublic class TypedCombineFnDelegate<InputT,AccumT,OutputT> extends Combine.CombineFn<InputT,AccumT,OutputT>
Combine.CombineFn
delegating all relevant calls to given delegate. This is used to
create a type anonymous class for cases where the CombineFn is a generic class. The anonymous
class can then be used in a UDAF as
.registerUdaf("UDAF", new TypedCombineFnDelegate<>(genericCombineFn) {})
Modifier | Constructor and Description |
---|---|
protected |
TypedCombineFnDelegate(Combine.CombineFn<InputT,AccumT,OutputT> delegate) |
Modifier and Type | Method and Description |
---|---|
AccumT |
addInput(AccumT mutableAccumulator,
InputT input)
Adds the given input value to the given accumulator, returning the new accumulator value.
|
OutputT |
apply(java.lang.Iterable<? extends InputT> inputs)
Applies this
CombineFn to a collection of input values to produce a combined output
value. |
AccumT |
compact(AccumT accumulator)
Returns an accumulator that represents the same logical value as the input accumulator, but
may have a more compact representation.
|
AccumT |
createAccumulator()
Returns a new, mutable accumulator value, representing the accumulation of zero input values.
|
OutputT |
defaultValue()
Returns the default value when there are no values added to the accumulator.
|
OutputT |
extractOutput(AccumT accumulator)
Returns the output value that is the result of combining all the input values represented by
the given accumulator.
|
java.lang.reflect.TypeVariable<?> |
getAccumTVariable()
Returns the
TypeVariable of AccumT . |
Coder<AccumT> |
getAccumulatorCoder(CoderRegistry registry,
Coder<InputT> inputCoder)
Returns the
Coder to use for accumulator AccumT values, or null if it is not
able to be inferred. |
Coder<OutputT> |
getDefaultOutputCoder(CoderRegistry registry,
Coder<InputT> inputCoder)
Returns the
Coder to use by default for output OutputT values, or null if it
is not able to be inferred. |
java.lang.String |
getIncompatibleGlobalWindowErrorMessage()
Returns the error message for not supported default values in Combine.globally().
|
java.lang.reflect.TypeVariable<?> |
getInputTVariable()
Returns the
TypeVariable of InputT . |
TypeDescriptor<InputT> |
getInputType()
Returns a
TypeDescriptor capturing what is known statically about the input type of
this CombineFn instance's most-derived class. |
java.lang.reflect.TypeVariable<?> |
getOutputTVariable()
Returns the
TypeVariable of OutputT . |
TypeDescriptor<OutputT> |
getOutputType()
Returns a
TypeDescriptor capturing what is known statically about the output type of
this CombineFn instance's most-derived class. |
AccumT |
mergeAccumulators(java.lang.Iterable<AccumT> accumulators)
Returns an accumulator representing the accumulation of all the input values accumulated in
the merging accumulators.
|
void |
populateDisplayData(DisplayData.Builder builder)
Register display data for the given transform or component.
|
protected TypedCombineFnDelegate(Combine.CombineFn<InputT,AccumT,OutputT> delegate)
public TypeDescriptor<OutputT> getOutputType()
Combine.CombineFn
TypeDescriptor
capturing what is known statically about the output type of
this CombineFn
instance's most-derived class.
In the normal case of a concrete CombineFn
subclass with no generic type
parameters of its own, this will be a complete non-generic type.
getOutputType
in class Combine.CombineFn<InputT,AccumT,OutputT>
public TypeDescriptor<InputT> getInputType()
Combine.CombineFn
TypeDescriptor
capturing what is known statically about the input type of
this CombineFn
instance's most-derived class.
In the normal case of a concrete CombineFn
subclass with no generic type
parameters of its own, this will be a complete non-generic type.
getInputType
in class Combine.CombineFn<InputT,AccumT,OutputT>
public AccumT createAccumulator()
Combine.CombineFn
createAccumulator
in class Combine.CombineFn<InputT,AccumT,OutputT>
public AccumT addInput(AccumT mutableAccumulator, InputT input)
Combine.CombineFn
addInput
in class Combine.CombineFn<InputT,AccumT,OutputT>
mutableAccumulator
- may be modified and returned for efficiencyinput
- should not be mutatedpublic AccumT mergeAccumulators(java.lang.Iterable<AccumT> accumulators)
Combine.CombineFn
mergeAccumulators
in class Combine.CombineFn<InputT,AccumT,OutputT>
accumulators
- only the first accumulator may be modified and returned for efficiency;
the other accumulators should not be mutated, because they may be shared with other code
and mutating them could lead to incorrect results or data corruption.public OutputT extractOutput(AccumT accumulator)
Combine.CombineFn
extractOutput
in class Combine.CombineFn<InputT,AccumT,OutputT>
accumulator
- can be modified for efficiencypublic AccumT compact(AccumT accumulator)
Combine.CombineFn
For most CombineFns this would be a no-op, but should be overridden by CombineFns that (for example) buffer up elements and combine them in batches.
For efficiency, the input accumulator may be modified and returned.
By default returns the original accumulator.
compact
in class Combine.CombineFn<InputT,AccumT,OutputT>
public OutputT apply(java.lang.Iterable<? extends InputT> inputs)
Combine.CombineFn
CombineFn
to a collection of input values to produce a combined output
value.
Useful when using a CombineFn
separately from a Combine
transform. Does
not invoke the Combine.CombineFn.mergeAccumulators(java.lang.Iterable<AccumT>)
operation.
apply
in class Combine.CombineFn<InputT,AccumT,OutputT>
public OutputT defaultValue()
Combine.CombineFn
By default returns the extract output of an empty accumulator.
defaultValue
in interface CombineFnBase.GlobalCombineFn<InputT,AccumT,OutputT>
defaultValue
in class Combine.CombineFn<InputT,AccumT,OutputT>
public Coder<AccumT> getAccumulatorCoder(CoderRegistry registry, Coder<InputT> inputCoder) throws CannotProvideCoderException
CombineFnBase.GlobalCombineFn
Coder
to use for accumulator AccumT
values, or null if it is not
able to be inferred.
By default, uses the knowledge of the Coder
being used for InputT
values
and the enclosing Pipeline
's CoderRegistry
to try to infer the Coder for
AccumT
values.
This is the Coder used to send data through a communication-intensive shuffle step, so a compact and efficient representation may have significant performance benefits.
getAccumulatorCoder
in interface CombineFnBase.GlobalCombineFn<InputT,AccumT,OutputT>
CannotProvideCoderException
public Coder<OutputT> getDefaultOutputCoder(CoderRegistry registry, Coder<InputT> inputCoder) throws CannotProvideCoderException
CombineFnBase.GlobalCombineFn
Coder
to use by default for output OutputT
values, or null if it
is not able to be inferred.
By default, uses the knowledge of the Coder
being used for input InputT
values and the enclosing Pipeline
's CoderRegistry
to try to infer the Coder
for OutputT
values.
getDefaultOutputCoder
in interface CombineFnBase.GlobalCombineFn<InputT,AccumT,OutputT>
CannotProvideCoderException
public java.lang.String getIncompatibleGlobalWindowErrorMessage()
CombineFnBase.GlobalCombineFn
getIncompatibleGlobalWindowErrorMessage
in interface CombineFnBase.GlobalCombineFn<InputT,AccumT,OutputT>
public java.lang.reflect.TypeVariable<?> getInputTVariable()
TypeVariable
of InputT
.public java.lang.reflect.TypeVariable<?> getAccumTVariable()
TypeVariable
of AccumT
.public java.lang.reflect.TypeVariable<?> getOutputTVariable()
TypeVariable
of OutputT
.public void populateDisplayData(DisplayData.Builder builder)
populateDisplayData(DisplayData.Builder)
is invoked by Pipeline runners to collect
display data via DisplayData.from(HasDisplayData)
. Implementations may call super.populateDisplayData(builder)
in order to register display data in the current namespace,
but should otherwise use subcomponent.populateDisplayData(builder)
to use the namespace
of the subcomponent.
By default, does not register any display data. Implementors may override this method to provide their own display data.
populateDisplayData
in interface HasDisplayData
builder
- The builder to populate with display data.HasDisplayData