org.apache.beam.it.gcp.datagenerator

Class DataGenerator

java.lang.Object

org.apache.beam.it.gcp.datagenerator.DataGenerator

public class DataGenerator
extends java.lang.Object

Helper class for starting a Streaming Data Generator Dataflow template job.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DataGenerator.AutoscalingAlgorithmType Enum representing Autoscaling algorithm types.
static class	DataGenerator.Builder Builder for the DataGenerator.

Method Summary

Modifier and Type	Method and Description
static DataGenerator.Builder	builderWithSchemaLocation(java.lang.String testName, java.lang.String schemaLocation)
static DataGenerator.Builder	builderWithSchemaTemplate(java.lang.String testName, java.lang.String schemaTemplate)
java.lang.Integer	execute(java.time.Duration timeout) Executes the data generator using the config provided.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

builderWithSchemaLocation

public static DataGenerator.Builder builderWithSchemaLocation(java.lang.String testName,
                                                              java.lang.String schemaLocation)

builderWithSchemaTemplate

public static DataGenerator.Builder builderWithSchemaTemplate(java.lang.String testName,
                                                              java.lang.String schemaTemplate)

execute

public java.lang.Integer execute(java.time.Duration timeout)
                          throws java.io.IOException

Executes the data generator using the config provided. If messageLimit is provided, we wait until the data generator finishes, or we reach timeout. If a messageLimit is not provided we wait until timeout and cancel the data generator.

Note: This is a blocking call. For backlog tests, start the Data generator before executing the template under test. For testing a pipeline against live incoming data, execute the data generator after starting the pipeline under test.

Parameters:

timeout - time to wait before cancelling the data generator.

Returns:

approximate number of messages generated

Throws:

java.io.IOException - if any errors are encountered.