Package org.apache.beam.runners.spark.coders

Class SparkRunnerKryoRegistrator

java.lang.Object

org.apache.beam.runners.spark.coders.SparkRunnerKryoRegistrator

All Implemented Interfaces:

org.apache.spark.serializer.KryoRegistrator

public class SparkRunnerKryoRegistrator
extends Object
implements org.apache.spark.serializer.KryoRegistrator

Custom KryoRegistrators for Beam's Spark runner needs and registering used class in spark translation for better serialization performance. This is not the default serialization mechanism.

To use it you must enable the Kryo based serializer using spark.serializer with value org.apache.spark.serializer.KryoSerializer and register this class via Spark spark.kryo.registrator configuration.

Constructor Summary

Constructors

Constructor	Description
SparkRunnerKryoRegistrator()

Method Summary

Modifier and Type	Method	Description
void	registerClasses(com.esotericsoftware.kryo.Kryo kryo)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SparkRunnerKryoRegistrator

public SparkRunnerKryoRegistrator()

Method Details

registerClasses

public void registerClasses(com.esotericsoftware.kryo.Kryo kryo)

Specified by:

registerClasses in interface org.apache.spark.serializer.KryoRegistrator