public class AsJsons.AsJsonsWithFailures<FailureT> extends PTransform<PCollection<InputT>,WithFailures.Result<PCollection<java.lang.String>,FailureT>>
PTransform
that adds exception handling to AsJsons
.annotations, displayData, name, resourceHints
Modifier and Type | Method and Description |
---|---|
AsJsons.AsJsonsWithFailures<FailureT> |
exceptionsVia(ProcessFunction<WithFailures.ExceptionElement<InputT>,FailureT> exceptionHandler)
Returns a new
AsJsons.AsJsonsWithFailures transform that catches exceptions raised while
writing JSON elements, passing the raised exception instance and the input element being
processed through the given exceptionHandler and emitting the result to a failure
collection. |
WithFailures.Result<PCollection<java.lang.String>,FailureT> |
expand(PCollection<InputT> input)
Override this method to specify how this
PTransform should be expanded on the given
InputT . |
addAnnotation, compose, compose, getAdditionalInputs, getAnnotations, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setDisplayData, setResourceHints, toString, validate, validate
public AsJsons.AsJsonsWithFailures<FailureT> exceptionsVia(ProcessFunction<WithFailures.ExceptionElement<InputT>,FailureT> exceptionHandler)
AsJsons.AsJsonsWithFailures
transform that catches exceptions raised while
writing JSON elements, passing the raised exception instance and the input element being
processed through the given exceptionHandler
and emitting the result to a failure
collection. It is supposed to be used along with AsJsons.exceptionsInto(TypeDescriptor)
and get lambda function as exception handler.
See WithFailures
documentation for usage patterns of the returned WithFailures.Result
.
Example usage:
WithFailures.Result<PCollection<String>, KV<MyPojo, Map<String, String>>> result =
pojos.apply(
AsJsons.of(MyPojo.class)
.exceptionsInto(
TypeDescriptors.kvs(
TypeDescriptor.of(MyPojo.class), TypeDescriptors.strings()))
.exceptionsVia(
f -> KV.of(f.element(), f.exception().getClass().getCanonicalName())));
PCollection<String> output = result.output(); // valid json elements
PCollection<KV<MyPojo, Map<String, String>>> failures = result.failures();
public WithFailures.Result<PCollection<java.lang.String>,FailureT> expand(PCollection<InputT> input)
PTransform
PTransform
should be expanded on the given
InputT
.
NOTE: This method should not be called directly. Instead apply the PTransform
should
be applied to the InputT
using the apply
method.
Composite transforms, which are defined in terms of other transforms, should return the output of one of the composed transforms. Non-composite transforms, which do not apply any transforms internally, should return a new unbound output and register evaluators (via backend-specific registration methods).
expand
in class PTransform<PCollection<InputT>,WithFailures.Result<PCollection<java.lang.String>,FailureT>>