org.apache.beam.runners.fnexecution.jobsubmission

Class PortablePipelineJarUtils

java.lang.Object

org.apache.beam.runners.fnexecution.jobsubmission.PortablePipelineJarUtils

public abstract class PortablePipelineJarUtils
extends java.lang.Object

Contains common code for writing and reading portable pipeline jars.

Jar layout:

• META-INF/
  • MANIFEST.MF
• BEAM-PIPELINE/
  • pipeline.json
  • pipeline-options.json
• BEAM-ARTIFACT-STAGING/
  • artifact-manifest.json
  • artifacts/
    • ...artifact files...
• ...Java classes...

Constructor Summary

Constructors

Constructor and Description
PortablePipelineJarUtils()

Method Summary

Modifier and Type	Method and Description
static org.apache.beam.model.jobmanagement.v1.ArtifactApi.ProxyManifest	getArtifactManifestFromClassPath()
static org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline	getPipelineFromClasspath()
static org.apache.beam.vendor.grpc.v1p21p0.com.google.protobuf.Struct	getPipelineOptionsFromClasspath()
static java.lang.String	stageArtifacts(org.apache.beam.model.jobmanagement.v1.ArtifactApi.ProxyManifest proxyManifest, PipelineOptions options, java.lang.String invocationId, java.lang.String artifactStagingPath) Writes artifacts listed in proxyManifest.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PortablePipelineJarUtils

public PortablePipelineJarUtils()

Method Detail

getPipelineFromClasspath

public static org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline getPipelineFromClasspath()
                                                                                     throws java.io.IOException

Throws:

java.io.IOException

getPipelineOptionsFromClasspath

public static org.apache.beam.vendor.grpc.v1p21p0.com.google.protobuf.Struct getPipelineOptionsFromClasspath()
                                                                                                      throws java.io.IOException

Throws:

java.io.IOException

getArtifactManifestFromClassPath

public static org.apache.beam.model.jobmanagement.v1.ArtifactApi.ProxyManifest getArtifactManifestFromClassPath()
                                                                                                         throws java.io.IOException

Throws:

java.io.IOException

stageArtifacts

public static java.lang.String stageArtifacts(org.apache.beam.model.jobmanagement.v1.ArtifactApi.ProxyManifest proxyManifest,
                                              PipelineOptions options,
                                              java.lang.String invocationId,
                                              java.lang.String artifactStagingPath)
                                       throws java.lang.Exception

Writes artifacts listed in proxyManifest.

Throws:

java.lang.Exception