org.apache.beam.sdk.io.hdfs

Interface HadoopFileSystemOptions

All Superinterfaces:

HasDisplayData, PipelineOptions

@Experimental(value=FILESYSTEM)
public interface HadoopFileSystemOptions
extends PipelineOptions

PipelineOptions which encapsulate Hadoop Configuration for the HadoopFileSystem.

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	HadoopFileSystemOptions.ConfigurationLocator A DefaultValueFactory which locates a Hadoop Configuration.

Nested classes/interfaces inherited from interface org.apache.beam.sdk.options.PipelineOptions

PipelineOptions.AtomicLongFactory, PipelineOptions.CheckEnabled, PipelineOptions.DirectRunner, PipelineOptions.JobNameFactory, PipelineOptions.NoOpMetricsSink, PipelineOptions.UserAgentFactory

Method Summary

Modifier and Type	Method and Description
java.util.List<org.apache.hadoop.conf.Configuration>	getHdfsConfiguration()
void	setHdfsConfiguration(java.util.List<org.apache.hadoop.conf.Configuration> value)

Methods inherited from interface org.apache.beam.sdk.options.PipelineOptions

as, getJobName, getMetricsHttpSinkUrl, getMetricsPushPeriod, getMetricsSink, getOptionsId, getRunner, getStableUniqueNames, getTempLocation, getUserAgent, outputRuntimeOptions, setJobName, setMetricsHttpSinkUrl, setMetricsPushPeriod, setMetricsSink, setOptionsId, setRunner, setStableUniqueNames, setTempLocation, setUserAgent

Methods inherited from interface org.apache.beam.sdk.transforms.display.HasDisplayData

populateDisplayData

Method Detail

getHdfsConfiguration

@Default.InstanceFactory(value=HadoopFileSystemOptions.ConfigurationLocator.class)
java.util.List<org.apache.hadoop.conf.Configuration> getHdfsConfiguration()

setHdfsConfiguration

void setHdfsConfiguration(java.util.List<org.apache.hadoop.conf.Configuration> value)