org.apache.beam.sdk.io.gcp.pubsub

Class TestPubsub

java.lang.Object

org.apache.beam.sdk.io.gcp.pubsub.TestPubsub

All Implemented Interfaces:

TestRule

public class TestPubsub
extends java.lang.Object
implements TestRule

Test rule which creates a new topic and subscription with randomized names and exposes the APIs to work with them.

Deletes topic and subscription on shutdown.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	TestPubsub.PollingAssertion

Method Summary

Modifier and Type	Method and Description
Statement	apply(Statement base, Description description)
TestPubsub.PollingAssertion	assertThatTopicEventuallyReceives(Matcher<PubsubMessage>... matchers) Repeatedly pull messages from subscriptionPath() until receiving one for each matcher (or timeout is reached), then assert that the received messages match the expectations.
void	checkIfAnySubscriptionExists(java.lang.String project, Duration timeoutDuration) Check if topics exist.
static TestPubsub	create() Creates an instance of this rule.
void	publish(java.util.List<PubsubMessage> messages) Publish messages to topicPath().
java.util.List<PubsubMessage>	pull() Pull up to 100 messages from subscriptionPath().
java.util.List<PubsubMessage>	pull(int maxBatchSize) Pull up to maxBatchSize messages from subscriptionPath().
PubsubClient.SubscriptionPath	subscriptionPath() Subscription path used to listen for messages on topicPath().
PubsubClient.TopicPath	topicPath() Topic path where events will be published to.
java.util.List<PubsubMessage>	waitForNMessages(int n, Duration timeoutDuration) Repeatedly pull messages from subscriptionPath(), returns after receiving n messages or after waiting for timeoutDuration.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

create

public static TestPubsub create()

Creates an instance of this rule.

Loads GCP configuration from TestPipelineOptions.

apply

public Statement apply(Statement base,
                       Description description)

Specified by:

apply in interface TestRule

topicPath

public PubsubClient.TopicPath topicPath()

Topic path where events will be published to.

subscriptionPath

public PubsubClient.SubscriptionPath subscriptionPath()

Subscription path used to listen for messages on topicPath().

publish

public void publish(java.util.List<PubsubMessage> messages)
             throws java.io.IOException

Publish messages to topicPath().

Throws:

java.io.IOException

pull

public java.util.List<PubsubMessage> pull()
                                   throws java.io.IOException

Pull up to 100 messages from subscriptionPath().

Throws:

java.io.IOException

pull

public java.util.List<PubsubMessage> pull(int maxBatchSize)
                                   throws java.io.IOException

Pull up to maxBatchSize messages from subscriptionPath().

Throws:

java.io.IOException

waitForNMessages

public java.util.List<PubsubMessage> waitForNMessages(int n,
                                                      Duration timeoutDuration)
                                               throws java.io.IOException,
                                                      java.lang.InterruptedException

Repeatedly pull messages from subscriptionPath(), returns after receiving n messages or after waiting for timeoutDuration.

Throws:

java.io.IOException

java.lang.InterruptedException

assertThatTopicEventuallyReceives

public TestPubsub.PollingAssertion assertThatTopicEventuallyReceives(Matcher<PubsubMessage>... matchers)

Repeatedly pull messages from subscriptionPath() until receiving one for each matcher (or timeout is reached), then assert that the received messages match the expectations.

Example usage:

{@code
 testTopic
   .assertThatTopicEventuallyReceives(
     hasProperty("payload", equalTo("hello".getBytes(StandardCharsets.US_ASCII))),
     hasProperty("payload", equalTo("world".getBytes(StandardCharsets.US_ASCII))))
   .waitForUpTo(Duration.standardSeconds(20));
 

checkIfAnySubscriptionExists

public void checkIfAnySubscriptionExists(java.lang.String project,
                                         Duration timeoutDuration)
                                  throws java.lang.InterruptedException,
                                         java.lang.IllegalArgumentException,
                                         java.io.IOException,
                                         java.util.concurrent.TimeoutException

Check if topics exist.

Parameters:

project - GCP project identifier.

timeoutDuration - Joda duration that sets a period of time before checking times out.

Throws:

java.lang.InterruptedException

java.lang.IllegalArgumentException

java.io.IOException

java.util.concurrent.TimeoutException