Class GroupByKeyStreamingTranslator<K,V>
java.lang.Object
org.apache.beam.runners.spark.structuredstreaming.translation.TransformTranslator<PCollection<KV<K,V>>,PCollection<KV<K,Iterable<V>>>,GroupByKey<K,V>>
org.apache.beam.runners.spark.structuredstreaming.translation.streaming.GroupByKeyStreamingTranslator<K,V>
@Internal
public class GroupByKeyStreamingTranslator<K,V>
extends TransformTranslator<PCollection<KV<K,V>>,PCollection<KV<K,Iterable<V>>>,GroupByKey<K,V>>
Translates
GroupByKey for Spark 4 Structured Streaming via transformWithState.-
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.beam.runners.spark.structuredstreaming.translation.TransformTranslator
TransformTranslator.Context -
Field Summary
Fields inherited from class org.apache.beam.runners.spark.structuredstreaming.translation.TransformTranslator
complexityFactor -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionprotected voidtranslate(GroupByKey<K, V> transform, TransformTranslator<PCollection<KV<K, V>>, PCollection<KV<K, Iterable<V>>>, GroupByKey<K, V>>.Context cxt) Methods inherited from class org.apache.beam.runners.spark.structuredstreaming.translation.TransformTranslator
canTranslate, windowCoder
-
Constructor Details
-
GroupByKeyStreamingTranslator
public GroupByKeyStreamingTranslator()
-
-
Method Details
-
translate
protected void translate(GroupByKey<K, V> transform, TransformTranslator<PCollection<KV<K, V>>, PCollection<KV<K, Iterable<V>>>, GroupByKey<K, V>>.Context cxt) - Specified by:
translatein classTransformTranslator<PCollection<KV<K,V>>, PCollection<KV<K, Iterable<V>>>, GroupByKey<K, V>>
-