Package org.apache.beam.sdk.io.hadoop

Class SerializableConfiguration

java.lang.Object

org.apache.beam.sdk.io.hadoop.SerializableConfiguration

All Implemented Interfaces:

Externalizable, Serializable

@NotThreadSafe
public class SerializableConfiguration
extends Object
implements Externalizable

A wrapper to allow Hadoop Configurations to be serialized using Java's standard serialization mechanisms.

SerializableConfiguration is not thread safe. For example, serialized configuration could be corrupted if writeExternal(java.io.ObjectOutput) and readExternal(java.io.ObjectInput) are run at the same time, or the Configuration is changed outside during writeExternal.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
SerializableConfiguration()
SerializableConfiguration(org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method	Description
static SerializableConfiguration	fromMap(Map<String,String> entries)	Returns a new configuration instance using provided flags.
org.apache.hadoop.conf.Configuration	get()
static org.apache.hadoop.conf.Configuration	newConfiguration(@Nullable SerializableConfiguration conf)	Returns new populated Configuration object.
static org.apache.hadoop.mapreduce.Job	newJob(@Nullable SerializableConfiguration conf)	Returns new configured Job object.
void	readExternal(ObjectInput in)
void	writeExternal(ObjectOutput out)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SerializableConfiguration

public SerializableConfiguration()

SerializableConfiguration

public SerializableConfiguration(org.apache.hadoop.conf.Configuration conf)

Method Details

get

public org.apache.hadoop.conf.Configuration get()

writeExternal

public void writeExternal(ObjectOutput out)
                   throws IOException

Specified by:

writeExternal in interface Externalizable

Throws:

IOException

readExternal

public void readExternal(ObjectInput in)
                  throws IOException,
ClassNotFoundException

Specified by:

readExternal in interface Externalizable

Throws:

IOException

ClassNotFoundException

newJob

public static org.apache.hadoop.mapreduce.Job newJob(@Nullable SerializableConfiguration conf)
                                              throws IOException

Returns new configured Job object.

Throws:

IOException

fromMap

public static SerializableConfiguration fromMap(Map<String,String> entries)

Returns a new configuration instance using provided flags.

newConfiguration

public static org.apache.hadoop.conf.Configuration newConfiguration(@Nullable SerializableConfiguration conf)

Returns new populated Configuration object.