org.apache.beam.sdk.options

Interface SdkHarnessOptions

All Superinterfaces:

HasDisplayData, PipelineOptions

@Experimental(value=PORTABILITY)
public interface SdkHarnessOptions
extends PipelineOptions

Options that are used to control configuration of the SDK harness.

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	SdkHarnessOptions.LogLevel The set of log levels that can be used in the SDK harness.
static class	SdkHarnessOptions.SdkHarnessLogLevelOverrides Defines a log level override for a specific class, package, or name.

Nested classes/interfaces inherited from interface org.apache.beam.sdk.options.PipelineOptions

PipelineOptions.AtomicLongFactory, PipelineOptions.CheckEnabled, PipelineOptions.DirectRunner, PipelineOptions.JobNameFactory, PipelineOptions.UserAgentFactory

Method Summary

Modifier and Type	Method and Description
SdkHarnessOptions.LogLevel	getDefaultSdkHarnessLogLevel() This option controls the default log level of all loggers without a log level override.
int	getGroupingTableMaxSizeMb() Size (in MB) of each grouping table used to pre-combine elements.
SdkHarnessOptions.SdkHarnessLogLevelOverrides	getSdkHarnessLogLevelOverrides() This option controls the log levels for specifically named loggers.
void	setDefaultSdkHarnessLogLevel(SdkHarnessOptions.LogLevel logLevel)
void	setGroupingTableMaxSizeMb(int value)
void	setSdkHarnessLogLevelOverrides(SdkHarnessOptions.SdkHarnessLogLevelOverrides value)

Methods inherited from interface org.apache.beam.sdk.options.PipelineOptions

as, getJobName, getOptionsId, getRunner, getStableUniqueNames, getTempLocation, getUserAgent, outputRuntimeOptions, setJobName, setOptionsId, setRunner, setStableUniqueNames, setTempLocation, setUserAgent

Methods inherited from interface org.apache.beam.sdk.transforms.display.HasDisplayData

populateDisplayData

Method Detail

getDefaultSdkHarnessLogLevel

@Default.Enum(value="INFO")
SdkHarnessOptions.LogLevel getDefaultSdkHarnessLogLevel()

This option controls the default log level of all loggers without a log level override.

setDefaultSdkHarnessLogLevel

void setDefaultSdkHarnessLogLevel(SdkHarnessOptions.LogLevel logLevel)

getSdkHarnessLogLevelOverrides

SdkHarnessOptions.SdkHarnessLogLevelOverrides getSdkHarnessLogLevelOverrides()

This option controls the log levels for specifically named loggers.

Later options with equivalent names override earlier options.

See SdkHarnessOptions.SdkHarnessLogLevelOverrides for more information on how to configure logging on a per Class, Package, or name basis. If used from the command line, the expected format is {"Name":"LogLevel",...}, further details on SdkHarnessOptions.SdkHarnessLogLevelOverrides.from(java.util.Map<java.lang.String, java.lang.String>).

setSdkHarnessLogLevelOverrides

void setSdkHarnessLogLevelOverrides(SdkHarnessOptions.SdkHarnessLogLevelOverrides value)

getGroupingTableMaxSizeMb

@Default.Integer(value=100)
int getGroupingTableMaxSizeMb()

Size (in MB) of each grouping table used to pre-combine elements. If unset, defaults to 100 MB.

CAUTION: If set too large, workers may run into OOM conditions more easily, each worker may have many grouping tables in-memory concurrently.

setGroupingTableMaxSizeMb

void setGroupingTableMaxSizeMb(int value)