org.apache.beam.sdk.io.hdfs

Interface HadoopFileSystemOptions

All Superinterfaces:

HasDisplayData, PipelineOptions

@Experimental(value=FILESYSTEM)
public interface HadoopFileSystemOptions
extends PipelineOptions

PipelineOptions which encapsulate Hadoop Configuration for the HadoopFileSystem.

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	HadoopFileSystemOptions.ConfigurationLocator A DefaultValueFactory which locates a Hadoop Configuration.

Nested classes/interfaces inherited from interface org.apache.beam.sdk.options.PipelineOptions

PipelineOptions.AtomicLongFactory, PipelineOptions.CheckEnabled, PipelineOptions.DirectRunner, PipelineOptions.JobNameFactory, PipelineOptions.NoOpMetricsSink, PipelineOptions.UserAgentFactory

Method Summary

Modifier and Type	Method and Description
java.util.List<org.apache.hadoop.conf.Configuration>	getHdfsConfiguration()
void	setHdfsConfiguration(java.util.List<org.apache.hadoop.conf.Configuration> value)

Methods inherited from interface org.apache.beam.sdk.options.PipelineOptions

as, getJobName, getMetricsGraphiteHost, getMetricsGraphitePort, getMetricsHttpSinkUrl, getMetricsPushPeriod, getMetricsSink, getOptionsId, getRunner, getStableUniqueNames, getTempLocation, getUserAgent, outputRuntimeOptions, setJobName, setMetricsGraphiteHost, setMetricsGraphitePort, setMetricsHttpSinkUrl, setMetricsPushPeriod, setMetricsSink, setOptionsId, setRunner, setStableUniqueNames, setTempLocation, setUserAgent

Methods inherited from interface org.apache.beam.sdk.transforms.display.HasDisplayData

populateDisplayData

Method Detail

getHdfsConfiguration

@Default.InstanceFactory(value=HadoopFileSystemOptions.ConfigurationLocator.class)
java.util.List<org.apache.hadoop.conf.Configuration> getHdfsConfiguration()

setHdfsConfiguration

void setHdfsConfiguration(java.util.List<org.apache.hadoop.conf.Configuration> value)