Package org.apache.beam.sdk.io

Class ReadAllViaFileBasedSourceTransform.SplitIntoRangesFn

java.lang.Object

org.apache.beam.sdk.transforms.DoFn<FileIO.ReadableFile,KV<FileIO.ReadableFile,OffsetRange>>

org.apache.beam.sdk.io.ReadAllViaFileBasedSourceTransform.SplitIntoRangesFn

All Implemented Interfaces:

Serializable, HasDisplayData

Enclosing class:

ReadAllViaFileBasedSourceTransform<InT,T>

public static class ReadAllViaFileBasedSourceTransform.SplitIntoRangesFn
extends DoFn<FileIO.ReadableFile,KV<FileIO.ReadableFile,OffsetRange>>

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.transforms.DoFn

DoFn.AlwaysFetched, DoFn.BoundedPerElement, DoFn.BundleFinalizer, DoFn.Element, DoFn.FieldAccess, DoFn.FinishBundle, DoFn.FinishBundleContext, DoFn.GetInitialRestriction, DoFn.GetInitialWatermarkEstimatorState, DoFn.GetRestrictionCoder, DoFn.GetSize, DoFn.GetWatermarkEstimatorStateCoder, DoFn.Key, DoFn.MultiOutputReceiver, DoFn.NewTracker, DoFn.NewWatermarkEstimator, DoFn.OnTimer, DoFn.OnTimerContext, DoFn.OnTimerFamily, DoFn.OnWindowExpiration, DoFn.OnWindowExpirationContext, DoFn.OutputReceiver<T>, DoFn.ProcessContext, DoFn.ProcessContinuation, DoFn.ProcessElement, DoFn.RequiresStableInput, DoFn.RequiresTimeSortedInput, DoFn.Restriction, DoFn.Setup, DoFn.SideInput, DoFn.SplitRestriction, DoFn.StartBundle, DoFn.StartBundleContext, DoFn.StateId, DoFn.Teardown, DoFn.TimerFamily, DoFn.TimerId, DoFn.Timestamp, DoFn.TruncateRestriction, DoFn.UnboundedPerElement, DoFn.WatermarkEstimatorState, DoFn.WindowedContext

Constructor Summary

Constructors

Constructor	Description
SplitIntoRangesFn(long desiredBundleSizeBytes)

Method Summary

Modifier and Type	Method	Description
void	process(DoFn<FileIO.ReadableFile,KV<FileIO.ReadableFile,OffsetRange>>.ProcessContext c)

Methods inherited from class org.apache.beam.sdk.transforms.DoFn

getAllowedTimestampSkew, getInputTypeDescriptor, getOutputTypeDescriptor, populateDisplayData, prepareForProcessing

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SplitIntoRangesFn

public SplitIntoRangesFn(long desiredBundleSizeBytes)

Method Details

process

@ProcessElement
public void process(DoFn<FileIO.ReadableFile,KV<FileIO.ReadableFile,OffsetRange>>.ProcessContext c)