org.apache.beam.sdk.extensions.sql.impl.rel

Class BeamIOSinkRel

java.lang.Object

org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.AbstractRelNode

org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.SingleRel

org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.core.TableModify

org.apache.beam.sdk.extensions.sql.impl.rel.BeamIOSinkRel

All Implemented Interfaces:

java.lang.Cloneable, BeamRelNode, org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.plan.RelOptNode, org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.RelNode, org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.sql2rel.RelStructuredTypeFlattener.SelfFlatteningRel

public class BeamIOSinkRel
extends org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.core.TableModify
implements BeamRelNode, org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.sql2rel.RelStructuredTypeFlattener.SelfFlatteningRel

BeamRelNode to replace a TableModify node.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.core.TableModify

org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.core.TableModify.Operation

Nested classes/interfaces inherited from interface org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.RelNode

org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.RelNode.Context

Field Summary

Fields inherited from class org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.core.TableModify

catalogReader, table

Fields inherited from class org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.SingleRel

input

Fields inherited from class org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.AbstractRelNode

digest, id, rowType, traitSet

Constructor Summary

Constructors

Constructor and Description

BeamIOSinkRel(org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.plan.RelOptCluster cluster, org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.plan.RelOptTable table, org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.prepare.Prepare.CatalogReader catalogReader, org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.RelNode child, org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.core.TableModify.Operation operation, java.util.List<java.lang.String> updateColumnList, java.util.List<org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rex.RexNode> sourceExpressionList, boolean flattened, BeamSqlTable sqlTable, java.util.Map<java.lang.String,java.lang.String> pipelineOptions)

Method Summary

Modifier and Type	Method and Description
BeamCostModel	beamComputeSelfCost(org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.plan.RelOptPlanner planner, org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.metadata.RelMetadataQuery mq) This method is called by org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner.NonCumulativeCostImpl.
PTransform<PCollectionList<Row>,PCollection<Row>>	buildPTransform()
org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.RelNode	copy(org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.plan.RelTraitSet traitSet, java.util.List<org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.RelNode> inputs)
NodeStats	estimateNodeStats(org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.metadata.RelMetadataQuery mq) This method is called by org.apache.beam.sdk.extensions.sql.impl.planner.RelMdNodeStats.
void	flattenRel(org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.sql2rel.RelStructuredTypeFlattener flattener)
java.util.Map<java.lang.String,java.lang.String>	getPipelineOptions() Perform a DFS(Depth-First-Search) to find the PipelineOptions config.
void	register(org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.plan.RelOptPlanner planner)

Methods inherited from class org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.core.TableModify

computeSelfCost, deriveRowType, explainTerms, getCatalogReader, getExpectedInputRowType, getOperation, getSourceExpressionList, getTable, getUpdateColumnList, isDelete, isFlattened, isInsert, isMerge, isUpdate

Methods inherited from class org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.SingleRel

childrenAccept, estimateRowCount, getInput, getInputs, replaceInput

Methods inherited from class org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.AbstractRelNode

accept, accept, collectVariablesSet, collectVariablesUsed, computeDigest, computeSelfCost, explain, getChildExps, getCluster, getCollationList, getConvention, getCorrelVariable, getDescription, getDigest, getId, getInput, getQuery, getRelTypeName, getRows, getRowType, getTraitSet, getVariablesSet, getVariablesStopped, isDistinct, isKey, isValid, isValid, metadata, onRegister, recomputeDigest, sole, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.beam.sdk.extensions.sql.impl.rel.BeamRelNode

getPCollectionInputs, isBounded

Methods inherited from interface org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.RelNode

accept, accept, childrenAccept, collectVariablesSet, collectVariablesUsed, computeSelfCost, computeSelfCost, estimateRowCount, explain, getChildExps, getCollationList, getConvention, getCorrelVariable, getExpectedInputRowType, getInput, getInputs, getQuery, getRelTypeName, getRows, getRowType, getTable, getVariablesSet, getVariablesStopped, isDistinct, isKey, isValid, isValid, metadata, onRegister, recomputeDigest, replaceInput

Methods inherited from interface org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.plan.RelOptNode

getCluster, getDescription, getDigest, getId, getTraitSet

Constructor Detail

BeamIOSinkRel

public BeamIOSinkRel(org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.plan.RelOptCluster cluster,
                     org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.plan.RelOptTable table,
                     org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.prepare.Prepare.CatalogReader catalogReader,
                     org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.RelNode child,
                     org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.core.TableModify.Operation operation,
                     java.util.List<java.lang.String> updateColumnList,
                     java.util.List<org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rex.RexNode> sourceExpressionList,
                     boolean flattened,
                     BeamSqlTable sqlTable,
                     java.util.Map<java.lang.String,java.lang.String> pipelineOptions)

Method Detail

estimateNodeStats

public NodeStats estimateNodeStats(org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.metadata.RelMetadataQuery mq)

Description copied from interface: BeamRelNode

This method is called by org.apache.beam.sdk.extensions.sql.impl.planner.RelMdNodeStats. This is currently only used in SQLTransform Path (and not JDBC path). When a RelNode wants to calculate its BeamCost or estimate its NodeStats, it may need NodeStat of its inputs. However, it should not call this directly (because maybe its inputs are not physical yet). It should call BeamSqlRelUtils.getNodeStats( org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.RelNode, org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.metadata.RelMetadataQuery) instead.

Specified by:

estimateNodeStats in interface BeamRelNode

beamComputeSelfCost

public BeamCostModel beamComputeSelfCost(org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.plan.RelOptPlanner planner,
                                         org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.metadata.RelMetadataQuery mq)

Description copied from interface: BeamRelNode

This method is called by org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner.NonCumulativeCostImpl. This is currently only used in SQLTransform Path (and not JDBC path). This is needed when Calcite Query Planner wants to get the cost of a plan. Instead of calling this directly for a node, if we needed that it should be obtained by calling mq.getNonCumulativeCost. This way RelMetadataQuery will call this method instead of ComputeSelfCost if the handler is set correctly (see org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner#convertToBeamRel(String))

Specified by:

beamComputeSelfCost in interface BeamRelNode

copy

public org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.RelNode copy(org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.plan.RelTraitSet traitSet,
                                                                                  java.util.List<org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.RelNode> inputs)

Specified by:

copy in interface org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.RelNode

Overrides:

copy in class org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.AbstractRelNode

flattenRel

public void flattenRel(org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.sql2rel.RelStructuredTypeFlattener flattener)

Specified by:

flattenRel in interface org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.sql2rel.RelStructuredTypeFlattener.SelfFlatteningRel

register

public void register(org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.plan.RelOptPlanner planner)

Specified by:

register in interface org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.RelNode

Overrides:

register in class org.apache.beam.vendor.calcite.v1_20_0.org.apache.calcite.rel.AbstractRelNode

buildPTransform

public PTransform<PCollectionList<Row>,PCollection<Row>> buildPTransform()

Specified by:

buildPTransform in interface BeamRelNode

getPipelineOptions

public java.util.Map<java.lang.String,java.lang.String> getPipelineOptions()

Description copied from interface: BeamRelNode

Perform a DFS(Depth-First-Search) to find the PipelineOptions config.

Specified by:

getPipelineOptions in interface BeamRelNode