org.apache.beam.sdk.io.gcp.healthcare

Class HealthcareIOErrorToTableRow<T>

java.lang.Object

org.apache.beam.sdk.io.gcp.healthcare.HealthcareIOErrorToTableRow<T>

Type Parameters:

T - the type parameter for the HealthcareIOError

All Implemented Interfaces:

java.io.Serializable, ProcessFunction<HealthcareIOError<T>,TableRow>, SerializableFunction<HealthcareIOError<T>,TableRow>

public class HealthcareIOErrorToTableRow<T>
extends java.lang.Object
implements SerializableFunction<HealthcareIOError<T>,TableRow>

Convenience transform to write dead-letter HealthcareIOErrors to BigQuery TableRows.

This can be used with BigQueryIO.Write#withSchema(TableSchema) by defining a dead letter table schema

 ...
 PCollection<HealthcareIOError<String>> errors = ...;

 TableSchema deadLetterSchema = new TableSchema();
 deadLetterSchema.setFields(HealthcareIOErrorToTableRow.TABLE_FIELD_SCHEMAS);
 TimePartitioning deadLetterPartitioning = new TimeParitioning();
 deadLetterPartitioning.setField(HealthcareIOErrorToTableRow.TIMESTAMP_FIELD_NAME);

 errors.apply(
    BigQueryIO.write()
      .to(options.getDeadLetterTable())
      .withFormatFunction(new HealthcareIOErrorToTableRow())
      .withSchema(deadLetterSchema)
      .withTimePartitioning(deadLetterPartitioning)
 );
 ***
 

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static java.util.List<TableFieldSchema>	TABLE_FIELD_SCHEMAS
static java.lang.String	TIMESTAMP_FIELD_NAME

Constructor Summary

Constructors

Constructor and Description
HealthcareIOErrorToTableRow()

Method Summary

Modifier and Type	Method and Description
TableRow	apply(HealthcareIOError<T> err) Returns the result of invoking this function on the given input.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

TIMESTAMP_FIELD_NAME

public static final java.lang.String TIMESTAMP_FIELD_NAME

See Also:

Constant Field Values

TABLE_FIELD_SCHEMAS

public static final java.util.List<TableFieldSchema> TABLE_FIELD_SCHEMAS

Constructor Detail

HealthcareIOErrorToTableRow

public HealthcareIOErrorToTableRow()

Method Detail

apply

public TableRow apply(HealthcareIOError<T> err)

Description copied from interface: SerializableFunction

Returns the result of invoking this function on the given input.

Specified by:

apply in interface ProcessFunction<HealthcareIOError<T>,TableRow>

Specified by:

apply in interface SerializableFunction<HealthcareIOError<T>,TableRow>