Package org.apache.beam.sdk.extensions.sql.zetasql.unnest

Class BeamZetaSqlUnnestRel

java.lang.Object
org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.AbstractRelNode
org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.SingleRel
org.apache.beam.sdk.extensions.sql.zetasql.unnest.ZetaSqlUnnest
org.apache.beam.sdk.extensions.sql.zetasql.unnest.BeamZetaSqlUnnestRel
All Implemented Interfaces:
Cloneable, BeamRelNode, org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.plan.RelOptNode, org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.RelNode
public class BeamZetaSqlUnnestRel extends ZetaSqlUnnest implements BeamRelNode
BeamRelNode to implement UNNEST, supporting specifically only Correlate with ZetaSqlUnnest.

This class is a copy of BeamUnnestRel except that in UnnestFn it does not treat elements of struct type differently.

Details of why unwrapping structs breaks ZetaSQL UNNEST syntax is in https://issues.apache.org/jira/browse/BEAM-10896.

  • Nested Class Summary

    Nested classes/interfaces inherited from interface org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.RelNode

    org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.RelNode.Context

  • Field Summary

    Fields inherited from class org.apache.beam.sdk.extensions.sql.zetasql.unnest.ZetaSqlUnnest

    withOrdinality

    Fields inherited from class org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.SingleRel

    input

    Fields inherited from class org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.AbstractRelNode

    digest, id, rowType, traitSet

  • Constructor Summary

    Constructors
    Constructor
    Description
    BeamZetaSqlUnnestRel(org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.plan.RelOptCluster cluster, org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.plan.RelTraitSet traitSet, org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.RelNode input, org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.type.RelDataType unnestType, List<Integer> unnestIndices)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    BeamCostModel
    beamComputeSelfCost(org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.plan.RelOptPlanner planner, BeamRelMetadataQuery mq)
    This method is called by org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner.NonCumulativeCostImpl.
    PTransform<PCollectionList<Row>,PCollection<Row>>
    buildPTransform()
     
    ZetaSqlUnnest
    copy(org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.plan.RelTraitSet traitSet, org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.RelNode input)
     
    protected org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.type.RelDataType
    deriveRowType()
     
    NodeStats
    estimateNodeStats(BeamRelMetadataQuery mq)
    This method is called by org.apache.beam.sdk.extensions.sql.impl.planner.RelMdNodeStats.
    org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.RelWriter
    explainTerms(org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.RelWriter pw)
     

    Methods inherited from class org.apache.beam.sdk.extensions.sql.zetasql.unnest.ZetaSqlUnnest

    copy, create, deriveUncollectRowType

    Methods inherited from class org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.SingleRel

    childrenAccept, estimateRowCount, getInput, getInputs, replaceInput

    Methods inherited from class org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.AbstractRelNode

    accept, accept, collectVariablesSet, collectVariablesUsed, computeSelfCost, deepEquals, deepHashCode, equals, explain, getCluster, getConvention, getCorrelVariable, getDescription, getDigest, getExpectedInputRowType, getId, getInput, getRelDigest, getRelTypeName, getRowType, getTable, getTraitSet, getVariablesSet, hashCode, isEnforcer, isValid, metadata, onRegister, recomputeDigest, register, sole, toString

    Methods inherited from class java.lang.Object

    clone, finalize, getClass, notify, notifyAll, wait, wait, wait

    Methods inherited from interface org.apache.beam.sdk.extensions.sql.impl.rel.BeamRelNode

    buildPTransform, getPCollectionInputs, getPipelineOptions, isBounded, withErrorsTransformer

    Methods inherited from interface org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.RelNode

    accept, accept, childrenAccept, collectVariablesSet, collectVariablesUsed, computeSelfCost, copy, deepEquals, deepHashCode, estimateRowCount, explain, explain, fieldIsNullable, getConvention, getCorrelVariable, getDigest, getExpectedInputRowType, getInput, getInputs, getRelDigest, getRelTypeName, getRowType, getTable, getVariablesSet, isEnforcer, isValid, metadata, onRegister, recomputeDigest, register, replaceInput

    Methods inherited from interface org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.plan.RelOptNode

    getCluster, getDescription, getId, getTraitSet

  • Constructor Details

    • BeamZetaSqlUnnestRel

      public BeamZetaSqlUnnestRel(org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.plan.RelOptCluster cluster, org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.plan.RelTraitSet traitSet, org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.RelNode input, org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.type.RelDataType unnestType, List<Integer> unnestIndices)

  • Method Details

    • copy

      public ZetaSqlUnnest copy(org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.plan.RelTraitSet traitSet, org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.RelNode input)
      Overrides:
      copy in class ZetaSqlUnnest

    • deriveRowType

      protected org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.type.RelDataType deriveRowType()
      Overrides:
      deriveRowType in class ZetaSqlUnnest

    • estimateNodeStats

      public NodeStats estimateNodeStats(BeamRelMetadataQuery mq)
      Description copied from interface: BeamRelNode
      This method is called by org.apache.beam.sdk.extensions.sql.impl.planner.RelMdNodeStats. This is currently only used in SQLTransform Path (and not JDBC path). When a RelNode wants to calculate its BeamCost or estimate its NodeStats, it may need NodeStat of its inputs. However, it should not call this directly (because maybe its inputs are not physical yet). It should call
      invalid reference 
      org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils#getNodeStats(org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.RelNode, org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.metadata.RelMetadataQuery)
      instead.
      Specified by:
      estimateNodeStats in interface BeamRelNode

    • beamComputeSelfCost

      public BeamCostModel beamComputeSelfCost(org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.plan.RelOptPlanner planner, BeamRelMetadataQuery mq)
      Description copied from interface: BeamRelNode
      This method is called by org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner.NonCumulativeCostImpl. This is currently only used in SQLTransform Path (and not JDBC path). This is needed when Calcite Query Planner wants to get the cost of a plan. Instead of calling this directly for a node, if we needed that it should be obtained by calling mq.getNonCumulativeCost. This way RelMetadataQuery will call this method instead of ComputeSelfCost if the handler is set correctly (see org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner#convertToBeamRel(String))
      Specified by:
      beamComputeSelfCost in interface BeamRelNode

    • explainTerms

      public org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.RelWriter explainTerms(org.apache.beam.vendor.calcite.v1_28_0.org.apache.calcite.rel.RelWriter pw)
      Overrides:
      explainTerms in class ZetaSqlUnnest

    • buildPTransform

      public PTransform<PCollectionList<Row>,PCollection<Row>> buildPTransform()
      Specified by:
      buildPTransform in interface BeamRelNode