org.apache.beam.runners.spark.coders

Class SparkRunnerKryoRegistrator

java.lang.Object

org.apache.beam.runners.spark.coders.SparkRunnerKryoRegistrator

All Implemented Interfaces:

org.apache.spark.serializer.KryoRegistrator

public class SparkRunnerKryoRegistrator
extends java.lang.Object
implements org.apache.spark.serializer.KryoRegistrator

Custom KryoRegistrators for Beam's Spark runner needs and registering used class in spark translation for better serialization performance. This is not the default serialization mechanism.

To use it you must enable the Kryo based serializer using spark.serializer with value org.apache.spark.serializer.KryoSerializer and register this class via Spark spark.kryo.registrator configuration.

Constructor Summary

Constructors

Constructor and Description
SparkRunnerKryoRegistrator()

Method Summary

Modifier and Type	Method and Description
void	registerClasses(com.esotericsoftware.kryo.Kryo kryo)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkRunnerKryoRegistrator

public SparkRunnerKryoRegistrator()

Method Detail

registerClasses

public void registerClasses(com.esotericsoftware.kryo.Kryo kryo)

Specified by:

registerClasses in interface org.apache.spark.serializer.KryoRegistrator