Package org.apache.beam.sdk.io.gcp.pubsub

Class PubsubGrpcClient

java.lang.Object

org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

org.apache.beam.sdk.io.gcp.pubsub.PubsubGrpcClient

All Implemented Interfaces:

Closeable, AutoCloseable

public class PubsubGrpcClient
extends PubsubClient

A helper class for talking to Pubsub via grpc.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

PubsubClient.IncomingMessage, PubsubClient.OutgoingMessage, PubsubClient.ProjectPath, PubsubClient.PubsubClientFactory, PubsubClient.SchemaPath, PubsubClient.SubscriptionPath, PubsubClient.TopicPath

Field Summary

Fields

Modifier and Type	Field	Description
static final PubsubClient.PubsubClientFactory	FACTORY	Factory for creating Pubsub clients using gRPC transport.

Method Summary

Modifier and Type	Method	Description
int	ackDeadlineSeconds(PubsubClient.SubscriptionPath subscription)	Return the ack deadline, in seconds, for subscription.
void	acknowledge(PubsubClient.SubscriptionPath subscription, List<String> ackIds)	Acknowldege messages from subscription with ackIds.
void	close()	Gracefully close the underlying netty channel.
void	createSchema(PubsubClient.SchemaPath schemaPath, String schemaContent, com.google.pubsub.v1.Schema.Type type)	Create Schema from Schema definition content.
void	createSubscription(PubsubClient.TopicPath topic, PubsubClient.SubscriptionPath subscription, int ackDeadlineSeconds)	Create subscription to topic.
void	createTopic(PubsubClient.TopicPath topic)	Create topic.
void	createTopic(PubsubClient.TopicPath topic, PubsubClient.SchemaPath schema)	Create {link TopicPath} with PubsubClient.SchemaPath.
void	deleteSchema(PubsubClient.SchemaPath schemaPath)	Delete PubsubClient.SchemaPath.
void	deleteSubscription(PubsubClient.SubscriptionPath subscription)	Delete subscription.
void	deleteTopic(PubsubClient.TopicPath topic)
Schema	getSchema(PubsubClient.SchemaPath schemaPath)	Return a Beam Schema from the Pub/Sub schema resource, if exists.
PubsubClient.SchemaPath	getSchemaPath(PubsubClient.TopicPath topicPath)	Return PubsubClient.SchemaPath from PubsubClient.TopicPath if exists.
boolean	isEOF()	Return true if PubsubClient.pull(long, org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.SubscriptionPath, int, boolean) will always return empty list.
boolean	isTopicExists(PubsubClient.TopicPath topic)	Return true if topic exists.
List<PubsubClient.SubscriptionPath>	listSubscriptions(PubsubClient.ProjectPath project, PubsubClient.TopicPath topic)	Return a list of subscriptions for topic in project.
List<PubsubClient.TopicPath>	listTopics(PubsubClient.ProjectPath project)	Return a list of topics for project.
void	modifyAckDeadline(PubsubClient.SubscriptionPath subscription, List<String> ackIds, int deadlineSeconds)	Modify the ack deadline for messages from subscription with ackIds to be deadlineSeconds from now.
int	publish(PubsubClient.TopicPath topic, List<PubsubClient.OutgoingMessage> outgoingMessages)	Publish outgoingMessages to Pubsub topic.
List<PubsubClient.IncomingMessage>	pull(long requestTimeMsSinceEpoch, PubsubClient.SubscriptionPath subscription, int batchSize, boolean returnImmediately)	Request the next batch of up to batchSize messages from subscription.

Methods inherited from class org.apache.beam.sdk.io.gcp.pubsub.PubsubClient

createRandomSubscription, extractTimestampAttribute, parseTimestampAsMsSinceEpoch, projectPathFromId, projectPathFromPath, schemaPathFromId, schemaPathFromPath, subscriptionPathFromName, subscriptionPathFromPath, topicPathFromName, topicPathFromPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

FACTORY

public static final PubsubClient.PubsubClientFactory FACTORY

Factory for creating Pubsub clients using gRPC transport.

Method Details

close

public void close()

Gracefully close the underlying netty channel.

publish

public int publish(PubsubClient.TopicPath topic,
 List<PubsubClient.OutgoingMessage> outgoingMessages)
            throws IOException

Description copied from class: PubsubClient

Publish outgoingMessages to Pubsub topic. Return number of messages published.

Specified by:

publish in class PubsubClient

Throws:

IOException

pull

public List<PubsubClient.IncomingMessage> pull(long requestTimeMsSinceEpoch,
 PubsubClient.SubscriptionPath subscription,
 int batchSize,
 boolean returnImmediately)
                                        throws IOException

Description copied from class: PubsubClient

Request the next batch of up to batchSize messages from subscription. Return the received messages, or empty collection if none were available. Does not wait for messages to arrive if returnImmediately is true. Returned messages will record their request time as requestTimeMsSinceEpoch.

Specified by:

pull in class PubsubClient

Throws:

IOException

acknowledge

public void acknowledge(PubsubClient.SubscriptionPath subscription,
 List<String> ackIds)
                 throws IOException

Description copied from class: PubsubClient

Acknowldege messages from subscription with ackIds.

Specified by:

acknowledge in class PubsubClient

Throws:

IOException

modifyAckDeadline

public void modifyAckDeadline(PubsubClient.SubscriptionPath subscription,
 List<String> ackIds,
 int deadlineSeconds)
                       throws IOException

Description copied from class: PubsubClient

Modify the ack deadline for messages from subscription with ackIds to be deadlineSeconds from now.

Specified by:

modifyAckDeadline in class PubsubClient

Throws:

IOException

createTopic

public void createTopic(PubsubClient.TopicPath topic)
                 throws IOException

Description copied from class: PubsubClient

Create topic.

Specified by:

createTopic in class PubsubClient

Throws:

IOException

createTopic

public void createTopic(PubsubClient.TopicPath topic,
 PubsubClient.SchemaPath schema)
                 throws IOException

Description copied from class: PubsubClient

Create {link TopicPath} with PubsubClient.SchemaPath.

Specified by:

createTopic in class PubsubClient

Throws:

IOException

deleteTopic

public void deleteTopic(PubsubClient.TopicPath topic)
                 throws IOException

Specified by:

deleteTopic in class PubsubClient

Throws:

IOException

listTopics

public List<PubsubClient.TopicPath> listTopics(PubsubClient.ProjectPath project)
                                        throws IOException

Description copied from class: PubsubClient

Return a list of topics for project.

Specified by:

listTopics in class PubsubClient

Throws:

IOException

isTopicExists

public boolean isTopicExists(PubsubClient.TopicPath topic)
                      throws IOException

Description copied from class: PubsubClient

Return true if topic exists.

Specified by:

isTopicExists in class PubsubClient

Throws:

IOException

createSubscription

public void createSubscription(PubsubClient.TopicPath topic,
 PubsubClient.SubscriptionPath subscription,
 int ackDeadlineSeconds)
                        throws IOException

Description copied from class: PubsubClient

Create subscription to topic.

Specified by:

createSubscription in class PubsubClient

Throws:

IOException

deleteSubscription

public void deleteSubscription(PubsubClient.SubscriptionPath subscription)
                        throws IOException

Description copied from class: PubsubClient

Delete subscription.

Specified by:

deleteSubscription in class PubsubClient

Throws:

IOException

listSubscriptions

public List<PubsubClient.SubscriptionPath> listSubscriptions(PubsubClient.ProjectPath project,
 PubsubClient.TopicPath topic)
                                                      throws IOException

Description copied from class: PubsubClient

Return a list of subscriptions for topic in project.

Specified by:

listSubscriptions in class PubsubClient

Throws:

IOException

ackDeadlineSeconds

public int ackDeadlineSeconds(PubsubClient.SubscriptionPath subscription)
                       throws IOException

Description copied from class: PubsubClient

Return the ack deadline, in seconds, for subscription.

Specified by:

ackDeadlineSeconds in class PubsubClient

Throws:

IOException

isEOF

public boolean isEOF()

Description copied from class: PubsubClient

Return true if PubsubClient.pull(long, org.apache.beam.sdk.io.gcp.pubsub.PubsubClient.SubscriptionPath, int, boolean) will always return empty list. Actual clients will return false. Test clients may return true to signal that all expected messages have been pulled and the test may complete.

Specified by:

isEOF in class PubsubClient

createSchema

public void createSchema(PubsubClient.SchemaPath schemaPath,
 String schemaContent,
 com.google.pubsub.v1.Schema.Type type)
                  throws IOException

Create Schema from Schema definition content.

Specified by:

createSchema in class PubsubClient

Throws:

IOException

deleteSchema

public void deleteSchema(PubsubClient.SchemaPath schemaPath)
                  throws IOException

Delete PubsubClient.SchemaPath.

Specified by:

deleteSchema in class PubsubClient

Throws:

IOException

getSchemaPath

public PubsubClient.SchemaPath getSchemaPath(PubsubClient.TopicPath topicPath)
                                      throws IOException

Return PubsubClient.SchemaPath from PubsubClient.TopicPath if exists.

Specified by:

getSchemaPath in class PubsubClient

Throws:

IOException

getSchema

public Schema getSchema(PubsubClient.SchemaPath schemaPath)
                 throws IOException

Return a Beam Schema from the Pub/Sub schema resource, if exists.

Specified by:

getSchema in class PubsubClient

Throws:

IOException