org.apache.beam.sdk.io.gcp.pubsub

Class PubsubGrpcClient

java.lang.Object

org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

public class PubsubGrpcClient
extends PubsubClient

A helper class for talking to Pubsub via grpc.

CAUTION: Currently uses the application default credentials and does not respect any credentials-related arguments in GcpOptions.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

PubsubClient.OutgoingMessage, PubsubClient.ProjectPath, PubsubClient.PubsubClientFactory, PubsubClient.SubscriptionPath, PubsubClient.TopicPath

Field Summary

Fields

Modifier and Type	Field and Description
static PubsubClient.PubsubClientFactory	FACTORY Factory for creating Pubsub clients using gRCP transport.

Method Summary

Modifier and Type	Method and Description
int	ackDeadlineSeconds(PubsubClient.SubscriptionPath subscription) Return the ack deadline, in seconds, for subscription.
void	acknowledge(PubsubClient.SubscriptionPath subscription, java.util.List<java.lang.String> ackIds) Acknowldege messages from subscription with ackIds.
void	close() Gracefully close the underlying netty channel.
void	createSubscription(PubsubClient.TopicPath topic, PubsubClient.SubscriptionPath subscription, int ackDeadlineSeconds) Create subscription to topic.
void	createTopic(PubsubClient.TopicPath topic) Create topic.
void	deleteSubscription(PubsubClient.SubscriptionPath subscription) Delete subscription.
void	deleteTopic(PubsubClient.TopicPath topic)
boolean	isEOF() Return true if PubsubClient.pull(long, org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.SubscriptionPath, int, boolean) will always return empty list.
java.util.List<PubsubClient.SubscriptionPath>	listSubscriptions(PubsubClient.ProjectPath project, PubsubClient.TopicPath topic) Return a list of subscriptions for topic in project.
java.util.List<PubsubClient.TopicPath>	listTopics(PubsubClient.ProjectPath project) Return a list of topics for project.
void	modifyAckDeadline(PubsubClient.SubscriptionPath subscription, java.util.List<java.lang.String> ackIds, int deadlineSeconds) Modify the ack deadline for messages from subscription with ackIds to be deadlineSeconds from now.
int	publish(PubsubClient.TopicPath topic, java.util.List<PubsubClient.OutgoingMessage> outgoingMessages) Publish outgoingMessages to Pubsub topic.
java.util.List<org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.IncomingMessage>	pull(long requestTimeMsSinceEpoch, PubsubClient.SubscriptionPath subscription, int batchSize, boolean returnImmediately) Request the next batch of up to batchSize messages from subscription.

Methods inherited from class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

createRandomSubscription, extractTimestamp, projectPathFromId, projectPathFromPath, subscriptionPathFromName, subscriptionPathFromPath, topicPathFromName, topicPathFromPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

FACTORY

public static final PubsubClient.PubsubClientFactory FACTORY

Factory for creating Pubsub clients using gRCP transport.

Method Detail

close

public void close()

Gracefully close the underlying netty channel.

publish

public int publish(PubsubClient.TopicPath topic,
                   java.util.List<PubsubClient.OutgoingMessage> outgoingMessages)
            throws java.io.IOException

Description copied from class: PubsubClient

Publish outgoingMessages to Pubsub topic. Return number of messages published.

Specified by:

publish in class PubsubClient

Throws:

java.io.IOException

pull

public java.util.List<org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.IncomingMessage> pull(long requestTimeMsSinceEpoch,
                                                                                           PubsubClient.SubscriptionPath subscription,
                                                                                           int batchSize,
                                                                                           boolean returnImmediately)
                                                                                    throws java.io.IOException

Description copied from class: PubsubClient

Request the next batch of up to batchSize messages from subscription. Return the received messages, or empty collection if none were available. Does not wait for messages to arrive if returnImmediately is true. Returned messages will record their request time as requestTimeMsSinceEpoch.

Specified by:

pull in class PubsubClient

Throws:

java.io.IOException

acknowledge

public void acknowledge(PubsubClient.SubscriptionPath subscription,
                        java.util.List<java.lang.String> ackIds)
                 throws java.io.IOException

Description copied from class: PubsubClient

Acknowldege messages from subscription with ackIds.

Specified by:

acknowledge in class PubsubClient

Throws:

java.io.IOException

modifyAckDeadline

public void modifyAckDeadline(PubsubClient.SubscriptionPath subscription,
                              java.util.List<java.lang.String> ackIds,
                              int deadlineSeconds)
                       throws java.io.IOException

Description copied from class: PubsubClient

Modify the ack deadline for messages from subscription with ackIds to be deadlineSeconds from now.

Specified by:

modifyAckDeadline in class PubsubClient

Throws:

java.io.IOException

createTopic

public void createTopic(PubsubClient.TopicPath topic)
                 throws java.io.IOException

Description copied from class: PubsubClient

Create topic.

Specified by:

createTopic in class PubsubClient

Throws:

java.io.IOException

deleteTopic

public void deleteTopic(PubsubClient.TopicPath topic)
                 throws java.io.IOException

Specified by:

deleteTopic in class PubsubClient

Throws:

java.io.IOException

listTopics

public java.util.List<PubsubClient.TopicPath> listTopics(PubsubClient.ProjectPath project)
                                                  throws java.io.IOException

Description copied from class: PubsubClient

Return a list of topics for project.

Specified by:

listTopics in class PubsubClient

Throws:

java.io.IOException

createSubscription

public void createSubscription(PubsubClient.TopicPath topic,
                               PubsubClient.SubscriptionPath subscription,
                               int ackDeadlineSeconds)
                        throws java.io.IOException

Description copied from class: PubsubClient

Create subscription to topic.

Specified by:

createSubscription in class PubsubClient

Throws:

java.io.IOException

deleteSubscription

public void deleteSubscription(PubsubClient.SubscriptionPath subscription)
                        throws java.io.IOException

Description copied from class: PubsubClient

Delete subscription.

Specified by:

deleteSubscription in class PubsubClient

Throws:

java.io.IOException

listSubscriptions

public java.util.List<PubsubClient.SubscriptionPath> listSubscriptions(PubsubClient.ProjectPath project,
                                                                       PubsubClient.TopicPath topic)
                                                                throws java.io.IOException

Description copied from class: PubsubClient

Return a list of subscriptions for topic in project.

Specified by:

listSubscriptions in class PubsubClient

Throws:

java.io.IOException

ackDeadlineSeconds

public int ackDeadlineSeconds(PubsubClient.SubscriptionPath subscription)
                       throws java.io.IOException

Description copied from class: PubsubClient

Return the ack deadline, in seconds, for subscription.

Specified by:

ackDeadlineSeconds in class PubsubClient

Throws:

java.io.IOException

isEOF

public boolean isEOF()

Description copied from class: PubsubClient

Return true if PubsubClient.pull(long, org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.SubscriptionPath, int, boolean) will always return empty list. Actual clients will return false. Test clients may return true to signal that all expected messages have been pulled and the test may complete.

Specified by:

isEOF in class PubsubClient