Package org.apache.beam.sdk.options
Interface StreamingOptions
- All Superinterfaces:
ApplicationNameOptions,HasDisplayData,PipelineOptions
- All Known Subinterfaces:
BigQueryOptions,CloudResourceManagerOptions,DataflowPipelineOptions,DataflowWorkerHarnessOptions,FlinkPipelineOptions,PubsubOptions,SnowflakePipelineOptions,SpannerIO.SpannerChangeStreamOptions,SparkCommonPipelineOptions,SparkContextOptions,SparkPipelineOptions,SparkPortableStreamingPipelineOptions,SparkStructuredStreamingPipelineOptions,TestBigQueryOptions,TestDataflowPipelineOptions,TestPubsubOptions,TestSparkPipelineOptions
Options used to configure streaming.
-
Nested Class Summary
Nested classes/interfaces inherited from interface org.apache.beam.sdk.options.PipelineOptions
PipelineOptions.AtomicLongFactory, PipelineOptions.CheckEnabled, PipelineOptions.DirectRunner, PipelineOptions.JobNameFactory, PipelineOptions.UserAgentFactory -
Method Summary
Modifier and TypeMethodDescriptionintThe desired number of initial splits for UnboundedSources.booleanSet to true if running a streaming pipeline.voidsetDesiredNumUnboundedSourceSplits(int value) voidsetStreaming(boolean value) voidsetUpdateCompatibilityVersion(@Nullable String updateCompatibilityVersion) static booleanupdateCompatibilityVersionLessThan(PipelineOptions options, String version) Methods inherited from interface org.apache.beam.sdk.options.ApplicationNameOptions
getAppName, setAppNameMethods inherited from interface org.apache.beam.sdk.transforms.display.HasDisplayData
populateDisplayDataMethods inherited from interface org.apache.beam.sdk.options.PipelineOptions
as, getGbek, getJobName, getOptionsId, getRunner, getStableUniqueNames, getTempLocation, getUserAgent, outputRuntimeOptions, revision, setGbek, setJobName, setOptionsId, setRunner, setStableUniqueNames, setTempLocation, setUserAgent
-
Method Details
-
isStreaming
Set to true if running a streaming pipeline. This will be automatically set to true if the pipeline contains an Unbounded PCollection. -
setStreaming
void setStreaming(boolean value) -
getUpdateCompatibilityVersion
-
setUpdateCompatibilityVersion
-
getDesiredNumUnboundedSourceSplits
The desired number of initial splits for UnboundedSources. If this value is invalid input: '<'=0, a default number of splits will be chosen. -
setDesiredNumUnboundedSourceSplits
void setDesiredNumUnboundedSourceSplits(int value) -
updateCompatibilityVersionLessThan
-