org.apache.beam.sdk.io.gcp.pubsub

Class PubsubGrpcClient

java.lang.Object

org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

public class PubsubGrpcClient
extends PubsubClient

A helper class for talking to Pubsub via grpc.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

PubsubClient.IncomingMessage, PubsubClient.OutgoingMessage, PubsubClient.ProjectPath, PubsubClient.PubsubClientFactory, PubsubClient.SchemaPath, PubsubClient.SubscriptionPath, PubsubClient.TopicPath

Field Summary

Fields

Modifier and Type	Field and Description
static PubsubClient.PubsubClientFactory	FACTORY Factory for creating Pubsub clients using gRPC transport.

Method Summary

Modifier and Type	Method and Description
int	ackDeadlineSeconds(PubsubClient.SubscriptionPath subscription) Return the ack deadline, in seconds, for subscription.
void	acknowledge(PubsubClient.SubscriptionPath subscription, java.util.List<java.lang.String> ackIds) Acknowldege messages from subscription with ackIds.
void	close() Gracefully close the underlying netty channel.
void	createSchema(PubsubClient.SchemaPath schemaPath, java.lang.String schemaContent, com.google.pubsub.v1.Schema.Type type) Create Schema from Schema definition content.
void	createSubscription(PubsubClient.TopicPath topic, PubsubClient.SubscriptionPath subscription, int ackDeadlineSeconds) Create subscription to topic.
void	createTopic(PubsubClient.TopicPath topic) Create topic.
void	createTopic(PubsubClient.TopicPath topic, PubsubClient.SchemaPath schema) Create {link TopicPath} with PubsubClient.SchemaPath.
void	deleteSchema(PubsubClient.SchemaPath schemaPath) Delete SchemaPath.
void	deleteSubscription(PubsubClient.SubscriptionPath subscription) Delete subscription.
void	deleteTopic(PubsubClient.TopicPath topic)
Schema	getSchema(PubsubClient.SchemaPath schemaPath) Return a Beam Schema from the Pub/Sub schema resource, if exists.
PubsubClient.SchemaPath	getSchemaPath(PubsubClient.TopicPath topicPath) Return SchemaPath from TopicPath if exists.
boolean	isEOF() Return true if PubsubClient.pull(long, org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.SubscriptionPath, int, boolean) will always return empty list.
boolean	isTopicExists(PubsubClient.TopicPath topic) Return true if topic exists.
java.util.List<PubsubClient.SubscriptionPath>	listSubscriptions(PubsubClient.ProjectPath project, PubsubClient.TopicPath topic) Return a list of subscriptions for topic in project.
java.util.List<PubsubClient.TopicPath>	listTopics(PubsubClient.ProjectPath project) Return a list of topics for project.
void	modifyAckDeadline(PubsubClient.SubscriptionPath subscription, java.util.List<java.lang.String> ackIds, int deadlineSeconds) Modify the ack deadline for messages from subscription with ackIds to be deadlineSeconds from now.
int	publish(PubsubClient.TopicPath topic, java.util.List<PubsubClient.OutgoingMessage> outgoingMessages) Publish outgoingMessages to Pubsub topic.
java.util.List<PubsubClient.IncomingMessage>	pull(long requestTimeMsSinceEpoch, PubsubClient.SubscriptionPath subscription, int batchSize, boolean returnImmediately) Request the next batch of up to batchSize messages from subscription.

Methods inherited from class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

createRandomSubscription, extractTimestampAttribute, parseTimestampAsMsSinceEpoch, projectPathFromId, projectPathFromPath, schemaPathFromId, schemaPathFromPath, subscriptionPathFromName, subscriptionPathFromPath, topicPathFromName, topicPathFromPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

FACTORY

public static final PubsubClient.PubsubClientFactory FACTORY

Factory for creating Pubsub clients using gRPC transport.

Method Detail

close

public void close()

Gracefully close the underlying netty channel.

publish

public int publish(PubsubClient.TopicPath topic,
                   java.util.List<PubsubClient.OutgoingMessage> outgoingMessages)
            throws java.io.IOException

Description copied from class: PubsubClient

Publish outgoingMessages to Pubsub topic. Return number of messages published.

Specified by:

publish in class PubsubClient

Throws:

java.io.IOException

pull

public java.util.List<PubsubClient.IncomingMessage> pull(long requestTimeMsSinceEpoch,
                                                         PubsubClient.SubscriptionPath subscription,
                                                         int batchSize,
                                                         boolean returnImmediately)
                                                  throws java.io.IOException

Description copied from class: PubsubClient

Request the next batch of up to batchSize messages from subscription. Return the received messages, or empty collection if none were available. Does not wait for messages to arrive if returnImmediately is true. Returned messages will record their request time as requestTimeMsSinceEpoch.

Specified by:

pull in class PubsubClient

Throws:

java.io.IOException

acknowledge

public void acknowledge(PubsubClient.SubscriptionPath subscription,
                        java.util.List<java.lang.String> ackIds)
                 throws java.io.IOException

Description copied from class: PubsubClient

Acknowldege messages from subscription with ackIds.

Specified by:

acknowledge in class PubsubClient

Throws:

java.io.IOException

modifyAckDeadline

public void modifyAckDeadline(PubsubClient.SubscriptionPath subscription,
                              java.util.List<java.lang.String> ackIds,
                              int deadlineSeconds)
                       throws java.io.IOException

Description copied from class: PubsubClient

Modify the ack deadline for messages from subscription with ackIds to be deadlineSeconds from now.

Specified by:

modifyAckDeadline in class PubsubClient

Throws:

java.io.IOException

createTopic

public void createTopic(PubsubClient.TopicPath topic)
                 throws java.io.IOException

Description copied from class: PubsubClient

Create topic.

Specified by:

createTopic in class PubsubClient

Throws:

java.io.IOException

createTopic

public void createTopic(PubsubClient.TopicPath topic,
                        PubsubClient.SchemaPath schema)
                 throws java.io.IOException

Description copied from class: PubsubClient

Create {link TopicPath} with PubsubClient.SchemaPath.

Specified by:

createTopic in class PubsubClient

Throws:

java.io.IOException

deleteTopic

public void deleteTopic(PubsubClient.TopicPath topic)
                 throws java.io.IOException

Specified by:

deleteTopic in class PubsubClient

Throws:

java.io.IOException

listTopics

public java.util.List<PubsubClient.TopicPath> listTopics(PubsubClient.ProjectPath project)
                                                  throws java.io.IOException

Description copied from class: PubsubClient

Return a list of topics for project.

Specified by:

listTopics in class PubsubClient

Throws:

java.io.IOException

isTopicExists

public boolean isTopicExists(PubsubClient.TopicPath topic)
                      throws java.io.IOException

Description copied from class: PubsubClient

Return true if topic exists.

Specified by:

isTopicExists in class PubsubClient

Throws:

java.io.IOException

createSubscription

public void createSubscription(PubsubClient.TopicPath topic,
                               PubsubClient.SubscriptionPath subscription,
                               int ackDeadlineSeconds)
                        throws java.io.IOException

Description copied from class: PubsubClient

Create subscription to topic.

Specified by:

createSubscription in class PubsubClient

Throws:

java.io.IOException

deleteSubscription

public void deleteSubscription(PubsubClient.SubscriptionPath subscription)
                        throws java.io.IOException

Description copied from class: PubsubClient

Delete subscription.

Specified by:

deleteSubscription in class PubsubClient

Throws:

java.io.IOException

listSubscriptions

public java.util.List<PubsubClient.SubscriptionPath> listSubscriptions(PubsubClient.ProjectPath project,
                                                                       PubsubClient.TopicPath topic)
                                                                throws java.io.IOException

Description copied from class: PubsubClient

Return a list of subscriptions for topic in project.

Specified by:

listSubscriptions in class PubsubClient

Throws:

java.io.IOException

ackDeadlineSeconds

public int ackDeadlineSeconds(PubsubClient.SubscriptionPath subscription)
                       throws java.io.IOException

Description copied from class: PubsubClient

Return the ack deadline, in seconds, for subscription.

Specified by:

ackDeadlineSeconds in class PubsubClient

Throws:

java.io.IOException

isEOF

public boolean isEOF()

Description copied from class: PubsubClient

Return true if PubsubClient.pull(long, org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.SubscriptionPath, int, boolean) will always return empty list. Actual clients will return false. Test clients may return true to signal that all expected messages have been pulled and the test may complete.

Specified by:

isEOF in class PubsubClient

createSchema

public void createSchema(PubsubClient.SchemaPath schemaPath,
                         java.lang.String schemaContent,
                         com.google.pubsub.v1.Schema.Type type)
                  throws java.io.IOException

Create Schema from Schema definition content.

Specified by:

createSchema in class PubsubClient

Throws:

java.io.IOException

deleteSchema

public void deleteSchema(PubsubClient.SchemaPath schemaPath)
                  throws java.io.IOException

Delete SchemaPath.

Specified by:

deleteSchema in class PubsubClient

Throws:

java.io.IOException

getSchemaPath

public PubsubClient.SchemaPath getSchemaPath(PubsubClient.TopicPath topicPath)
                                      throws java.io.IOException

Return SchemaPath from TopicPath if exists.

Specified by:

getSchemaPath in class PubsubClient

Throws:

java.io.IOException

getSchema

public Schema getSchema(PubsubClient.SchemaPath schemaPath)
                 throws java.io.IOException

Return a Beam Schema from the Pub/Sub schema resource, if exists.

Specified by:

getSchema in class PubsubClient

Throws:

java.io.IOException