org.apache.beam.runners.fnexecution.jobsubmission

Class InMemoryJobService

java.lang.Object

org.apache.beam.model.jobmanagement.v1.JobServiceGrpc.JobServiceImplBase

org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService

All Implemented Interfaces:

io.grpc.BindableService, java.lang.AutoCloseable, FnService

public class InMemoryJobService
extends org.apache.beam.model.jobmanagement.v1.JobServiceGrpc.JobServiceImplBase
implements FnService

A InMemoryJobService that prepares and runs jobs on behalf of a client using a JobInvoker.

Job management is handled in-memory rather than any persistent storage, running the risk of leaking jobs if the InMemoryJobService crashes.

TODO: replace in-memory job management state with persistent solution.

Method Summary

Modifier and Type	Method and Description
void	cancel(org.apache.beam.model.jobmanagement.v1.JobApi.CancelJobRequest request, io.grpc.stub.StreamObserver<org.apache.beam.model.jobmanagement.v1.JobApi.CancelJobResponse> responseObserver)
void	close() .
static InMemoryJobService	create(org.apache.beam.model.pipeline.v1.Endpoints.ApiServiceDescriptor stagingServiceDescriptor, JobInvoker invoker)
void	getMessageStream(org.apache.beam.model.jobmanagement.v1.JobApi.JobMessagesRequest request, io.grpc.stub.StreamObserver<org.apache.beam.model.jobmanagement.v1.JobApi.JobMessagesResponse> responseObserver)
void	getState(org.apache.beam.model.jobmanagement.v1.JobApi.GetJobStateRequest request, io.grpc.stub.StreamObserver<org.apache.beam.model.jobmanagement.v1.JobApi.GetJobStateResponse> responseObserver)
void	getStateStream(org.apache.beam.model.jobmanagement.v1.JobApi.GetJobStateRequest request, io.grpc.stub.StreamObserver<org.apache.beam.model.jobmanagement.v1.JobApi.GetJobStateResponse> responseObserver)
void	prepare(org.apache.beam.model.jobmanagement.v1.JobApi.PrepareJobRequest request, io.grpc.stub.StreamObserver<org.apache.beam.model.jobmanagement.v1.JobApi.PrepareJobResponse> responseObserver)
void	run(org.apache.beam.model.jobmanagement.v1.JobApi.RunJobRequest request, io.grpc.stub.StreamObserver<org.apache.beam.model.jobmanagement.v1.JobApi.RunJobResponse> responseObserver)

Methods inherited from class org.apache.beam.model.jobmanagement.v1.JobServiceGrpc.JobServiceImplBase

bindService

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface io.grpc.BindableService

bindService

Method Detail

create

public static InMemoryJobService create(org.apache.beam.model.pipeline.v1.Endpoints.ApiServiceDescriptor stagingServiceDescriptor,
                                        JobInvoker invoker)

prepare

public void prepare(org.apache.beam.model.jobmanagement.v1.JobApi.PrepareJobRequest request,
                    io.grpc.stub.StreamObserver<org.apache.beam.model.jobmanagement.v1.JobApi.PrepareJobResponse> responseObserver)

Overrides:

prepare in class org.apache.beam.model.jobmanagement.v1.JobServiceGrpc.JobServiceImplBase

run

public void run(org.apache.beam.model.jobmanagement.v1.JobApi.RunJobRequest request,
                io.grpc.stub.StreamObserver<org.apache.beam.model.jobmanagement.v1.JobApi.RunJobResponse> responseObserver)

Overrides:

run in class org.apache.beam.model.jobmanagement.v1.JobServiceGrpc.JobServiceImplBase

getState

public void getState(org.apache.beam.model.jobmanagement.v1.JobApi.GetJobStateRequest request,
                     io.grpc.stub.StreamObserver<org.apache.beam.model.jobmanagement.v1.JobApi.GetJobStateResponse> responseObserver)

Overrides:

getState in class org.apache.beam.model.jobmanagement.v1.JobServiceGrpc.JobServiceImplBase

cancel

public void cancel(org.apache.beam.model.jobmanagement.v1.JobApi.CancelJobRequest request,
                   io.grpc.stub.StreamObserver<org.apache.beam.model.jobmanagement.v1.JobApi.CancelJobResponse> responseObserver)

Overrides:

cancel in class org.apache.beam.model.jobmanagement.v1.JobServiceGrpc.JobServiceImplBase

getStateStream

public void getStateStream(org.apache.beam.model.jobmanagement.v1.JobApi.GetJobStateRequest request,
                           io.grpc.stub.StreamObserver<org.apache.beam.model.jobmanagement.v1.JobApi.GetJobStateResponse> responseObserver)

Overrides:

getStateStream in class org.apache.beam.model.jobmanagement.v1.JobServiceGrpc.JobServiceImplBase

getMessageStream

public void getMessageStream(org.apache.beam.model.jobmanagement.v1.JobApi.JobMessagesRequest request,
                             io.grpc.stub.StreamObserver<org.apache.beam.model.jobmanagement.v1.JobApi.JobMessagesResponse> responseObserver)

Overrides:

getMessageStream in class org.apache.beam.model.jobmanagement.v1.JobServiceGrpc.JobServiceImplBase

close

public void close()
           throws java.lang.Exception

Description copied from interface: FnService

.

There should be no more calls to any service method by the time a call to FnService.close() begins. Specifically, this means that a Server that this service is bound to should have completed a call to the Server.shutdown() method, and all future incoming calls will be rejected.

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface FnService

Throws:

java.lang.Exception