K- The type of key being reshuffled on.
V- The type of value being reshuffled.
@Internal @Deprecated public class Reshuffle<K,V> extends PTransform<PCollection<KV<K,V>>,PCollection<KV<K,V>>>
PTransform that returns a
PCollection equivalent to its input but
operationally provides some of the side effects of a
GroupByKey, in particular preventing
fusion of the surrounding transforms, checkpointing and deduplication by id.
GroupByKey so that the data is key-partitioned. Configures the
WindowingStrategy so that no data is dropped, but doesn't affect the need for the user to
specify allowed lateness and accumulation mode before a user-inserted GroupByKey.
|Modifier and Type||Class and Description|
|Modifier and Type||Method and Description|
Override this method to specify how this
Encapsulates the sequence "pair input with unique key, apply
getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, populateDisplayData, toString, validate
public static <K,V> Reshuffle<K,V> of()
@Experimental public static <T> Reshuffle.ViaRandomKey<T> viaRandomKey()
of(), drop the key" commonly used to break fusion.
public PCollection<KV<K,V>> expand(PCollection<KV<K,V>> input)
PTransformshould be expanded on the given
NOTE: This method should not be called directly. Instead apply the
be applied to the
InputT using the
Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).