Package org.apache.beam.sdk.io

Class ReadAllViaFileBasedSourceTransform.AbstractReadFileRangesFn<InT,T>

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<KV<FileIO.ReadableFile,OffsetRange>,T>

org.apache.beam.sdk.io.ReadAllViaFileBasedSourceTransform.AbstractReadFileRangesFn<InT,T>

All Implemented Interfaces:

Serializable, HasDisplayData

Enclosing class:

ReadAllViaFileBasedSourceTransform<InT,T>

public abstract static class ReadAllViaFileBasedSourceTransform.AbstractReadFileRangesFn<InT,T>
extends DoFn<KV<FileIO.ReadableFile,OffsetRange>,T>

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

DoFn.AlwaysFetched, DoFn.BoundedPerElement, DoFn.BundleFinalizer, DoFn.Element, DoFn.FieldAccess, DoFn.FinishBundle, DoFn.FinishBundleContext, DoFn.GetInitialRestriction, DoFn.GetInitialWatermarkEstimatorState, DoFn.GetRestrictionCoder, DoFn.GetSize, DoFn.GetWatermarkEstimatorStateCoder, DoFn.Key, DoFn.MultiOutputReceiver, DoFn.NewTracker, DoFn.NewWatermarkEstimator, DoFn.OnTimer, DoFn.OnTimerContext, DoFn.OnTimerFamily, DoFn.OnWindowExpiration, DoFn.OnWindowExpirationContext, DoFn.OutputReceiver<T>, DoFn.ProcessContext, DoFn.ProcessContinuation, DoFn.ProcessElement, DoFn.RequiresStableInput, DoFn.RequiresTimeSortedInput, DoFn.Restriction, DoFn.Setup, DoFn.SideInput, DoFn.SplitRestriction, DoFn.StartBundle, DoFn.StartBundleContext, DoFn.StateId, DoFn.Teardown, DoFn.TimerFamily, DoFn.TimerId, DoFn.Timestamp, DoFn.TruncateRestriction, DoFn.UnboundedPerElement, DoFn.WatermarkEstimatorState, DoFn.WindowedContext

Constructor Summary

Constructors

Constructor	Description
AbstractReadFileRangesFn(SerializableFunction<String,? extends FileBasedSource<InT>> createSource, ReadAllViaFileBasedSource.ReadFileRangesFnExceptionHandler exceptionHandler)

Method Summary

Modifier and Type	Method	Description
protected abstract T	makeOutput(FileIO.ReadableFile file, OffsetRange range, FileBasedSource<InT> fileBasedSource, BoundedSource.BoundedReader<InT> reader)
void	process(DoFn<KV<FileIO.ReadableFile,OffsetRange>,T>.ProcessContext c)

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, prepareForProcessing

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

AbstractReadFileRangesFn

public AbstractReadFileRangesFn(SerializableFunction<String,? extends FileBasedSource<InT>> createSource,
 ReadAllViaFileBasedSource.ReadFileRangesFnExceptionHandler exceptionHandler)

Method Details

makeOutput

protected abstract T makeOutput(FileIO.ReadableFile file,
 OffsetRange range,
 FileBasedSource<InT> fileBasedSource,
 BoundedSource.BoundedReader<InT> reader)

process

@ProcessElement
public void process(DoFn<KV<FileIO.ReadableFile,OffsetRange>,T>.ProcessContext c)
             throws IOException

Throws:

IOException