Package org.apache.beam.runners.spark.translation

Class GroupByKeyVisitor

java.lang.Object

org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

org.apache.beam.runners.spark.translation.GroupByKeyVisitor

All Implemented Interfaces:

Pipeline.PipelineVisitor

public class GroupByKeyVisitor
extends Pipeline.PipelineVisitor.Defaults

Traverses the pipeline to populate the candidates for group by key.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.beam.sdk.Pipeline.PipelineVisitor

Pipeline.PipelineVisitor.CompositeBehavior, Pipeline.PipelineVisitor.Defaults

Field Summary

Fields

Modifier and Type	Field	Description
protected final EvaluationContext	ctxt
protected final SparkPipelineTranslator	translator

Constructor Summary

Constructors

Constructor	Description
GroupByKeyVisitor(SparkPipelineTranslator translator, EvaluationContext evaluationContext)

Method Summary

Modifier and Type	Method	Description
Pipeline.PipelineVisitor.CompositeBehavior	enterCompositeTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)	Called for each composite transform after all topological predecessors have been visited but before any of its component transforms.
void	leaveCompositeTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)	Called for each composite transform after all of its component transforms and their outputs have been visited.
void	visitPrimitiveTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)	Called for each primitive transform after all of its topological predecessors and inputs have been visited.

Methods inherited from class org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

enterPipeline, getPipeline, leavePipeline, visitValue

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

ctxt

protected final EvaluationContext ctxt

translator

protected final SparkPipelineTranslator translator

Constructor Details

GroupByKeyVisitor

public GroupByKeyVisitor(SparkPipelineTranslator translator,
 EvaluationContext evaluationContext)

Method Details

enterCompositeTransform

public Pipeline.PipelineVisitor.CompositeBehavior enterCompositeTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)

Description copied from interface: Pipeline.PipelineVisitor

Called for each composite transform after all topological predecessors have been visited but before any of its component transforms.

The return value controls whether or not child transforms are visited.

Specified by:

enterCompositeTransform in interface Pipeline.PipelineVisitor

Overrides:

enterCompositeTransform in class Pipeline.PipelineVisitor.Defaults

leaveCompositeTransform

public void leaveCompositeTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)

Description copied from interface: Pipeline.PipelineVisitor

Called for each composite transform after all of its component transforms and their outputs have been visited.

Specified by:

leaveCompositeTransform in interface Pipeline.PipelineVisitor

Overrides:

leaveCompositeTransform in class Pipeline.PipelineVisitor.Defaults

visitPrimitiveTransform

public void visitPrimitiveTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)

Description copied from interface: Pipeline.PipelineVisitor

Called for each primitive transform after all of its topological predecessors and inputs have been visited.

Specified by:

visitPrimitiveTransform in interface Pipeline.PipelineVisitor

Overrides:

visitPrimitiveTransform in class Pipeline.PipelineVisitor.Defaults