org.apache.beam.sdk.extensions.ml

Class CloudVision.AnnotateImagesFromGcsUriWithContext

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<PCollection<T>,PCollection<java.util.List<com.google.cloud.vision.v1.AnnotateImageResponse>>>

org.apache.beam.sdk.extensions.ml.CloudVision.AnnotateImagesFromGcsUriWithContext

All Implemented Interfaces:

java.io.Serializable, HasDisplayData

Enclosing class:

CloudVision

public static class CloudVision.AnnotateImagesFromGcsUriWithContext
extends PTransform<PCollection<T>,PCollection<java.util.List<com.google.cloud.vision.v1.AnnotateImageResponse>>>

Accepts KVs of String (GCS URI to the image) and ImageContext. It's possible to add ImageContext to each image to be annotated.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	org.apache.beam.sdk.extensions.ml.AnnotateImages.PerformImageAnnotation The DoFn performing the calls to Cloud Vision API.

Field Summary

Fields

Modifier and Type	Field and Description
protected PCollectionView<java.util.Map<T,com.google.cloud.vision.v1.ImageContext>>	contextSideInput
protected int	desiredRequestParallelism
protected java.util.List<com.google.cloud.vision.v1.Feature>	featureList

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

name, resourceHints

Constructor Summary

Constructors

Constructor and Description
AnnotateImagesFromGcsUriWithContext(java.util.List<com.google.cloud.vision.v1.Feature> featureList, long batchSize, int desiredRequestParallelism)

Method Summary

Modifier and Type	Method and Description
PCollection<java.util.List<com.google.cloud.vision.v1.AnnotateImageResponse>>	expand(PCollection<T> input) Applies all necessary transforms to call the Vision API.
com.google.cloud.vision.v1.AnnotateImageRequest	mapToRequest(KV<java.lang.String,com.google.cloud.vision.v1.ImageContext> input, @Nullable com.google.cloud.vision.v1.ImageContext ctx) Maps KV of String (GCS URI to the image) and ImageContext to a valid AnnotateImageRequest.

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

compose, compose, getAdditionalInputs, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setResourceHints, toString, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

contextSideInput

protected final PCollectionView<java.util.Map<T,com.google.cloud.vision.v1.ImageContext>> contextSideInput

featureList

protected final java.util.List<com.google.cloud.vision.v1.Feature> featureList

desiredRequestParallelism

protected final int desiredRequestParallelism

Constructor Detail

AnnotateImagesFromGcsUriWithContext

public AnnotateImagesFromGcsUriWithContext(java.util.List<com.google.cloud.vision.v1.Feature> featureList,
                                           long batchSize,
                                           int desiredRequestParallelism)

Method Detail

mapToRequest

public com.google.cloud.vision.v1.AnnotateImageRequest mapToRequest(KV<java.lang.String,com.google.cloud.vision.v1.ImageContext> input,
                                                                    @Nullable com.google.cloud.vision.v1.ImageContext ctx)

Maps KV of String (GCS URI to the image) and ImageContext to a valid AnnotateImageRequest.

Parameters:

input - Input element.

ctx - optional image context, ignored here since the input holds context.

Returns:

a valid request.

expand

public PCollection<java.util.List<com.google.cloud.vision.v1.AnnotateImageResponse>> expand(PCollection<T> input)

Applies all necessary transforms to call the Vision API. In order to group requests into batches, we assign keys to the requests, as GroupIntoBatches works only on KVs.

Specified by:

expand in class PTransform<PCollection<T>,PCollection<java.util.List<com.google.cloud.vision.v1.AnnotateImageResponse>>>