Package org.apache.beam.sdk.io.hdfs

Interface HadoopFileSystemOptions

All Superinterfaces:

HasDisplayData, PipelineOptions

public interface HadoopFileSystemOptions
extends PipelineOptions

PipelineOptions which encapsulate Hadoop Configuration for the HadoopFileSystem.

Nested Class Summary

Nested Classes

Modifier and Type	Interface	Description
static class	HadoopFileSystemOptions.ConfigurationLocator	A DefaultValueFactory which locates a Hadoop Configuration.

Nested classes/interfaces inherited from interface org.apache.beam.sdk.options.PipelineOptions

PipelineOptions.AtomicLongFactory, PipelineOptions.CheckEnabled, PipelineOptions.DirectRunner, PipelineOptions.JobNameFactory, PipelineOptions.UserAgentFactory

Method Summary

Modifier and Type	Method	Description
List<org.apache.hadoop.conf.Configuration>	getHdfsConfiguration()
void	setHdfsConfiguration(List<org.apache.hadoop.conf.Configuration> value)

Methods inherited from interface org.apache.beam.sdk.transforms.display.HasDisplayData

populateDisplayData

Methods inherited from interface org.apache.beam.sdk.options.PipelineOptions

as, getJobName, getOptionsId, getRunner, getStableUniqueNames, getTempLocation, getUserAgent, outputRuntimeOptions, revision, setJobName, setOptionsId, setRunner, setStableUniqueNames, setTempLocation, setUserAgent

Method Details

getHdfsConfiguration

@InstanceFactory(ConfigurationLocator.class)
List<org.apache.hadoop.conf.Configuration> getHdfsConfiguration()

setHdfsConfiguration

void setHdfsConfiguration(List<org.apache.hadoop.conf.Configuration> value)