public class BigtableRowToBeamRowFlat extends PTransform<PCollection<com.google.bigtable.v2.Row>,PCollection<Row>>
Requires a mapping which column family corresponds to which column
Bigtable Row
is mapped to Beam Row
in the following
way:
row: key, columnFamily[] -> BEAM_ROW
columnFamily: familyName, column[] -> not mapped directly
column: columnQualifier, cell[] -> most recent cell
cell: value, timestampMicros, labels -> VALUE
Mapped Beam Row
:
BEAM_ROW: ROW VALUE: Beam Schema
type except for ARRAY, DECIMAL, ITERABLE, MAP, ROW
annotations, displayData, name, resourceHints
Constructor and Description |
---|
BigtableRowToBeamRowFlat(Schema schema,
java.util.Map<java.lang.String,java.util.Set<java.lang.String>> columnsMapping) |
Modifier and Type | Method and Description |
---|---|
PCollection<Row> |
expand(PCollection<com.google.bigtable.v2.Row> input)
Override this method to specify how this
PTransform should be expanded on the given
InputT . |
addAnnotation, compose, compose, getAdditionalInputs, getAnnotations, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setDisplayData, setResourceHints, toString, validate, validate
public BigtableRowToBeamRowFlat(Schema schema, java.util.Map<java.lang.String,java.util.Set<java.lang.String>> columnsMapping)
public PCollection<Row> expand(PCollection<com.google.bigtable.v2.Row> input)
PTransform
PTransform
should be expanded on the given
InputT
.
NOTE: This method should not be called directly. Instead apply the PTransform
should
be applied to the InputT
using the apply
method.
Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).
expand
in class PTransform<PCollection<com.google.bigtable.v2.Row>,PCollection<Row>>