public static class Group.CombineFieldsByFields<InputT> extends PTransform<PCollection<InputT>,PCollection<KV<Row,Row>>>
PTransform
that does a per-key combine using an aggregation built up by calls to
aggregateField and aggregateFields. The output of this transform will have a schema that is
determined by the output types of all the composed combiners.name
Modifier and Type | Method and Description |
---|---|
<CombineInputT,AccumT,CombineOutputT> |
aggregateField(int inputFieldId,
Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn,
Schema.Field outputField) |
<CombineInputT,AccumT,CombineOutputT> |
aggregateField(int inputFieldId,
Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn,
java.lang.String outputFieldName) |
<CombineInputT,AccumT,CombineOutputT> |
aggregateField(java.lang.String inputFieldName,
Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn,
Schema.Field outputField)
Build up an aggregation function over the input elements.
|
<CombineInputT,AccumT,CombineOutputT> |
aggregateField(java.lang.String inputFieldName,
Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn,
java.lang.String outputFieldName)
Build up an aggregation function over the input elements.
|
<CombineInputT,AccumT,CombineOutputT> |
aggregateFields(FieldAccessDescriptor fieldsToAggregate,
Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn,
Schema.Field outputField)
Build up an aggregation function over the input elements.
|
<CombineInputT,AccumT,CombineOutputT> |
aggregateFields(FieldAccessDescriptor fieldsToAggregate,
Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn,
java.lang.String outputFieldName)
Build up an aggregation function over the input elements.
|
<CombineInputT,AccumT,CombineOutputT> |
aggregateFields(java.util.List<java.lang.String> inputFieldNames,
Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn,
Schema.Field outputField)
Build up an aggregation function over the input elements.
|
<CombineInputT,AccumT,CombineOutputT> |
aggregateFields(java.util.List<java.lang.String> inputFieldNames,
Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn,
java.lang.String outputFieldName)
Build up an aggregation function over the input elements.
|
<CombineInputT,AccumT,CombineOutputT> |
aggregateFieldsById(java.util.List<java.lang.Integer> inputFieldIds,
Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn,
Schema.Field outputField) |
PCollection<KV<Row,Row>> |
expand(PCollection<InputT> input)
Override this method to specify how this
PTransform should be expanded on the given
InputT . |
compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, populateDisplayData, toString, validate
public <CombineInputT,AccumT,CombineOutputT> Group.CombineFieldsByFields<InputT> aggregateField(java.lang.String inputFieldName, Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn, java.lang.String outputFieldName)
This method specifies an aggregation over single field of the input. The union of all calls to aggregateField and aggregateFields will determine the output schema.
Field types in the output schema will be inferred from the provided combine function. Sometimes the field type cannot be inferred due to Java's type erasure. In that case, use the overload that allows setting the output field type explicitly.
public <CombineInputT,AccumT,CombineOutputT> Group.CombineFieldsByFields<InputT> aggregateField(int inputFieldId, Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn, java.lang.String outputFieldName)
public <CombineInputT,AccumT,CombineOutputT> Group.CombineFieldsByFields<InputT> aggregateField(java.lang.String inputFieldName, Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn, Schema.Field outputField)
This method specifies an aggregation over single field of the input. The union of all calls to aggregateField and aggregateFields will determine the output schema.
public <CombineInputT,AccumT,CombineOutputT> Group.CombineFieldsByFields<InputT> aggregateField(int inputFieldId, Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn, Schema.Field outputField)
public <CombineInputT,AccumT,CombineOutputT> Group.CombineFieldsByFields<InputT> aggregateFields(java.util.List<java.lang.String> inputFieldNames, Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn, java.lang.String outputFieldName)
This method specifies an aggregation over multiple fields of the input. The union of all calls to aggregateField and aggregateFields will determine the output schema.
Field types in the output schema will be inferred from the provided combine function. Sometimes the field type cannot be inferred due to Java's type erasure. In that case, use the overload that allows setting the output field type explicitly.
public <CombineInputT,AccumT,CombineOutputT> Group.CombineFieldsByFields<InputT> aggregateFields(FieldAccessDescriptor fieldsToAggregate, Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn, java.lang.String outputFieldName)
This method specifies an aggregation over multiple fields of the input. The union of all calls to aggregateField and aggregateFields will determine the output schema.
Field types in the output schema will be inferred from the provided combine function. Sometimes the field type cannot be inferred due to Java's type erasure. In that case, use the overload that allows setting the output field type explicitly.
public <CombineInputT,AccumT,CombineOutputT> Group.CombineFieldsByFields<InputT> aggregateFields(java.util.List<java.lang.String> inputFieldNames, Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn, Schema.Field outputField)
This method specifies an aggregation over multiple fields of the input. The union of all calls to aggregateField and aggregateFields will determine the output schema.
public <CombineInputT,AccumT,CombineOutputT> Group.CombineFieldsByFields<InputT> aggregateFieldsById(java.util.List<java.lang.Integer> inputFieldIds, Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn, Schema.Field outputField)
public <CombineInputT,AccumT,CombineOutputT> Group.CombineFieldsByFields<InputT> aggregateFields(FieldAccessDescriptor fieldsToAggregate, Combine.CombineFn<CombineInputT,AccumT,CombineOutputT> fn, Schema.Field outputField)
This method specifies an aggregation over multiple fields of the input. The union of all calls to aggregateField and aggregateFields will determine the output schema.
public PCollection<KV<Row,Row>> expand(PCollection<InputT> input)
PTransform
PTransform
should be expanded on the given
InputT
.
NOTE: This method should not be called directly. Instead apply the PTransform
should
be applied to the InputT
using the apply
method.
Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).
expand
in class PTransform<PCollection<InputT>,PCollection<KV<Row,Row>>>