public class ApexYarnLauncher
extends java.lang.Object
The proxy takes the DAG and communicates with the Hadoop services to launch it on the cluster.
Modifier and Type | Class and Description |
---|---|
protected static class |
ApexYarnLauncher.LaunchParams
Launch parameters that will be serialized and passed to the child process.
|
static class |
ApexYarnLauncher.ProcessWatcher
Starts a command and waits for it to complete.
|
Constructor and Description |
---|
ApexYarnLauncher() |
Modifier and Type | Method and Description |
---|---|
static void |
addProperties(org.apache.hadoop.conf.Configuration conf,
java.util.Properties props)
Transfer the properties to the configuration object.
|
static void |
createJar(java.io.File dir,
java.io.File jarFile)
Create a jar file from the given directory.
|
static java.util.List<java.io.File> |
getYarnDeployDependencies()
From the current classpath, find the jar files that need to be deployed with the application to
run on YARN.
|
protected org.apache.apex.api.Launcher.AppHandle |
launchApp(ApexYarnLauncher.LaunchParams params) |
org.apache.apex.api.Launcher.AppHandle |
launchApp(com.datatorrent.api.StreamingApplication app,
java.util.Properties configProperties) |
static void |
main(java.lang.String[] args)
The main method expects the serialized DAG and will launch the YARN application.
|
public org.apache.apex.api.Launcher.AppHandle launchApp(com.datatorrent.api.StreamingApplication app, java.util.Properties configProperties) throws java.io.IOException
java.io.IOException
protected org.apache.apex.api.Launcher.AppHandle launchApp(ApexYarnLauncher.LaunchParams params) throws java.io.IOException
java.io.IOException
public static java.util.List<java.io.File> getYarnDeployDependencies() throws java.io.IOException
java.io.IOException
- when dependency information cannot be readpublic static void createJar(java.io.File dir, java.io.File jarFile) throws java.io.IOException
dir
- source directoryjarFile
- jar file namejava.io.IOException
- when file cannot be createdpublic static void addProperties(org.apache.hadoop.conf.Configuration conf, java.util.Properties props)
public static void main(java.lang.String[] args) throws java.io.IOException
args
- location of launch parametersjava.io.IOException
- when parameters cannot be read