org.apache.beam.sdk.schemas

Class SchemaRegistry

java.lang.Object

org.apache.beam.sdk.schemas.SchemaRegistry

@Experimental(value=SCHEMAS)
public class SchemaRegistry
extends java.lang.Object

A SchemaRegistry allows registering Schemas for a given Java Class or a TypeDescriptor.

Types registered in a pipeline's schema registry will automatically be discovered by any PCollection that uses SchemaCoder. This allows users to write pipelines in terms of their own Java types, yet still register schemas for these types.

TODO: Provide support for schemas registered via a ServiceLoader interface. This will allow optional modules to register schemas as well.

Method Summary

Modifier and Type	Method and Description
static SchemaRegistry	createDefault()
<T> SerializableFunction<Row,T>	getFromRowFunction(java.lang.Class<T> clazz) Rerieve the function that converts a Row object to an object of the specified type.
<T> SerializableFunction<Row,T>	getFromRowFunction(TypeDescriptor<T> typeDescriptor) Rerieve the function that converts a Row object to an object of the specified type.
<T> Schema	getSchema(java.lang.Class<T> clazz) Get a schema for a given Class type.
<T> Schema	getSchema(TypeDescriptor<T> typeDescriptor) Retrieve a schema for a given TypeDescriptor type.
<T> SerializableFunction<T,Row>	getToRowFunction(java.lang.Class<T> clazz) Rerieve the function that converts an object of the specified type to a Row object.
<T> SerializableFunction<T,Row>	getToRowFunction(TypeDescriptor<T> typeDescriptor) Rerieve the function that converts an object of the specified type to a Row object.
<T> void	registerSchemaForClass(java.lang.Class<T> clazz, Schema schema, SerializableFunction<T,Row> toRow, SerializableFunction<Row,T> fromRow) Register a schema for a specific Class type.
<T> void	registerSchemaForType(TypeDescriptor<T> type, Schema schema, SerializableFunction<T,Row> toRow, SerializableFunction<Row,T> fromRow) Register a schema for a specific TypeDescriptor type.
void	registerSchemaProvider(SchemaProvider schemaProvider) Register a SchemaProvider.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

createDefault

public static SchemaRegistry createDefault()

registerSchemaForClass

public <T> void registerSchemaForClass(java.lang.Class<T> clazz,
                                       Schema schema,
                                       SerializableFunction<T,Row> toRow,
                                       SerializableFunction<Row,T> fromRow)

Register a schema for a specific Class type.

registerSchemaForType

public <T> void registerSchemaForType(TypeDescriptor<T> type,
                                      Schema schema,
                                      SerializableFunction<T,Row> toRow,
                                      SerializableFunction<Row,T> fromRow)

Register a schema for a specific TypeDescriptor type.

registerSchemaProvider

public void registerSchemaProvider(SchemaProvider schemaProvider)

Register a SchemaProvider.

A SchemaProvider allows for deferred lookups of per-type schemas. This can be used when schemas are registered in an external service. The SchemaProvider will lookup the type in the external service and return the correct Schema.

getSchema

public <T> Schema getSchema(java.lang.Class<T> clazz)
                     throws NoSuchSchemaException

Get a schema for a given Class type. If no schema exists, throws NoSuchSchemaException.

Throws:

NoSuchSchemaException

getSchema

public <T> Schema getSchema(TypeDescriptor<T> typeDescriptor)
                     throws NoSuchSchemaException

Retrieve a schema for a given TypeDescriptor type. If no schema exists, throws NoSuchSchemaException.

Throws:

NoSuchSchemaException

getToRowFunction

public <T> SerializableFunction<T,Row> getToRowFunction(java.lang.Class<T> clazz)
                                                 throws NoSuchSchemaException

Rerieve the function that converts an object of the specified type to a Row object.

Throws:

NoSuchSchemaException

getToRowFunction

public <T> SerializableFunction<T,Row> getToRowFunction(TypeDescriptor<T> typeDescriptor)
                                                 throws NoSuchSchemaException

Rerieve the function that converts an object of the specified type to a Row object.

Throws:

NoSuchSchemaException

getFromRowFunction

public <T> SerializableFunction<Row,T> getFromRowFunction(java.lang.Class<T> clazz)
                                                   throws NoSuchSchemaException

Rerieve the function that converts a Row object to an object of the specified type.

Throws:

NoSuchSchemaException

getFromRowFunction

public <T> SerializableFunction<Row,T> getFromRowFunction(TypeDescriptor<T> typeDescriptor)
                                                   throws NoSuchSchemaException

Rerieve the function that converts a Row object to an object of the specified type.

Throws:

NoSuchSchemaException