org.apache.beam.runners.spark.coders

Class BeamSparkRunnerRegistrator

java.lang.Object

org.apache.beam.runners.spark.coders.BeamSparkRunnerRegistrator

All Implemented Interfaces:

org.apache.spark.serializer.KryoRegistrator

public class BeamSparkRunnerRegistrator
extends java.lang.Object
implements org.apache.spark.serializer.KryoRegistrator

Custom KryoRegistrators for Beam's Spark runner needs and registering used class in spark translation for better serialization performance. This is not the default serialization mechanism.

To use it you must enable the Kryo based serializer using spark.serializer with value org.apache.spark.serializer.KryoSerializer and register this class via Spark spark.kryo.registrator configuration.

Constructor Summary

Constructors

Constructor and Description
BeamSparkRunnerRegistrator()

Method Summary

Modifier and Type	Method and Description
void	registerClasses(com.esotericsoftware.kryo.Kryo kryo)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BeamSparkRunnerRegistrator

public BeamSparkRunnerRegistrator()

Method Detail

registerClasses

public void registerClasses(com.esotericsoftware.kryo.Kryo kryo)

Specified by:

registerClasses in interface org.apache.spark.serializer.KryoRegistrator