org.apache.beam.sdk.io

Class ReadAllViaFileBasedSourceTransform.AbstractReadFileRangesFn<InT,T>

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<KV<FileIO.ReadableFile,OffsetRange>,T>

org.apache.beam.sdk.io.ReadAllViaFileBasedSourceTransform.AbstractReadFileRangesFn<InT,T>

All Implemented Interfaces:

java.io.Serializable, HasDisplayData

Enclosing class:

ReadAllViaFileBasedSourceTransform<InT,T>

public abstract static class ReadAllViaFileBasedSourceTransform.AbstractReadFileRangesFn<InT,T>
extends DoFn<KV<FileIO.ReadableFile,OffsetRange>,T>

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

DoFn.AlwaysFetched, DoFn.BoundedPerElement, DoFn.BundleFinalizer, DoFn.Element, DoFn.FieldAccess, DoFn.FinishBundle, DoFn.FinishBundleContext, DoFn.GetInitialRestriction, DoFn.GetInitialWatermarkEstimatorState, DoFn.GetRestrictionCoder, DoFn.GetSize, DoFn.GetWatermarkEstimatorStateCoder, DoFn.Key, DoFn.MultiOutputReceiver, DoFn.NewTracker, DoFn.NewWatermarkEstimator, DoFn.OnTimer, DoFn.OnTimerContext, DoFn.OnTimerFamily, DoFn.OnWindowExpiration, DoFn.OnWindowExpirationContext, DoFn.OutputReceiver<T>, DoFn.ProcessContext, DoFn.ProcessContinuation, DoFn.ProcessElement, DoFn.RequiresStableInput, DoFn.RequiresTimeSortedInput, DoFn.Restriction, DoFn.Setup, DoFn.SideInput, DoFn.SplitRestriction, DoFn.StartBundle, DoFn.StartBundleContext, DoFn.StateId, DoFn.Teardown, DoFn.TimerFamily, DoFn.TimerId, DoFn.Timestamp, DoFn.TruncateRestriction, DoFn.UnboundedPerElement, DoFn.WatermarkEstimatorState, DoFn.WindowedContext

Constructor Summary

Constructors

Constructor and Description
AbstractReadFileRangesFn(SerializableFunction<java.lang.String,? extends FileBasedSource<InT>> createSource, ReadAllViaFileBasedSource.ReadFileRangesFnExceptionHandler exceptionHandler)

Method Summary

Modifier and Type	Method and Description
protected abstract T	makeOutput(FileIO.ReadableFile file, OffsetRange range, FileBasedSource<InT> fileBasedSource, BoundedSource.BoundedReader<InT> reader)
void	process(DoFn.ProcessContext c)

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, prepareForProcessing

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AbstractReadFileRangesFn

public AbstractReadFileRangesFn(SerializableFunction<java.lang.String,? extends FileBasedSource<InT>> createSource,
                                ReadAllViaFileBasedSource.ReadFileRangesFnExceptionHandler exceptionHandler)

Method Detail

makeOutput

protected abstract T makeOutput(FileIO.ReadableFile file,
                                OffsetRange range,
                                FileBasedSource<InT> fileBasedSource,
                                BoundedSource.BoundedReader<InT> reader)

process

@DoFn.ProcessElement
public void process(DoFn.ProcessContext c)
                                  throws java.io.IOException

Throws:

java.io.IOException