org.apache.beam.sdk.extensions.ml

Class VideoIntelligence

java.lang.Object

org.apache.beam.sdk.extensions.ml.VideoIntelligence

@Experimental
public class VideoIntelligence
extends java.lang.Object

Factory class for AnnotateVideo subclasses. allows integration with Google Cloud AI - VideoIntelligence service. Converts GCS URIs of videos or ByteStrings with video contents into Lists of VideoAnnotationResults.

Adding a side input of Maps of elements to VideoContext objects is allowed, so is using KVs of element and VideoContext as input.

Service account with proper permissions is required to use these transforms.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	VideoIntelligence.AnnotateVideoBytesWithContext Implementation of AnnotateVideo accepting KVs as contents of input PCollection.
static class	VideoIntelligence.AnnotateVideoFromBytes Implementation of AnnotateVideo accepting ByteStrings as contents of input PCollection.
static class	VideoIntelligence.AnnotateVideoFromURI Implementation of AnnotateVideo accepting Strings as contents of input PCollection.
static class	VideoIntelligence.AnnotateVideoURIWithContext Implementation of AnnotateVideo accepting KVs as contents of input PCollection.

Constructor Summary

Constructors

Constructor and Description
VideoIntelligence()

Method Summary

Modifier and Type	Method and Description
static VideoIntelligence.AnnotateVideoFromBytes	annotateFromBytes(PCollectionView<java.util.Map<ByteString,com.google.cloud.videointelligence.v1.VideoContext>> contextSideInput, java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList) Annotates videos from ByteStrings of their contents.
static VideoIntelligence.AnnotateVideoBytesWithContext	annotateFromBytesWithContext(java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList) Annotates videos from key-value pairs of ByteStrings and VideoContext.
static VideoIntelligence.AnnotateVideoFromURI	annotateFromURI(java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList, PCollectionView<java.util.Map<java.lang.String,com.google.cloud.videointelligence.v1.VideoContext>> contextSideInput) Annotates videos from GCS URIs.
static VideoIntelligence.AnnotateVideoURIWithContext	annotateFromUriWithContext(java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList) Annotates videos from key-value pairs of GCS URI and VideoContext.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

VideoIntelligence

public VideoIntelligence()

Method Detail

annotateFromURI

public static VideoIntelligence.AnnotateVideoFromURI annotateFromURI(java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList,
                                                                     PCollectionView<java.util.Map<java.lang.String,com.google.cloud.videointelligence.v1.VideoContext>> contextSideInput)

Annotates videos from GCS URIs.

Parameters:

featureList - List of features to be annotated

contextSideInput - Optional side input with map of contexts to URIs

Returns:

DoFn performing the necessary operations

annotateFromBytes

public static VideoIntelligence.AnnotateVideoFromBytes annotateFromBytes(PCollectionView<java.util.Map<ByteString,com.google.cloud.videointelligence.v1.VideoContext>> contextSideInput,
                                                                         java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList)

Annotates videos from ByteStrings of their contents.

Parameters:

featureList - List of features to be annotated

contextSideInput - Optional side input with map of contexts to ByteStrings

Returns:

DoFn performing the necessary operations

annotateFromUriWithContext

public static VideoIntelligence.AnnotateVideoURIWithContext annotateFromUriWithContext(java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList)

Annotates videos from key-value pairs of GCS URI and VideoContext.

Parameters:

featureList - List of features to be annotated

Returns:

DoFn performing the necessary operations

annotateFromBytesWithContext

public static VideoIntelligence.AnnotateVideoBytesWithContext annotateFromBytesWithContext(java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList)

Annotates videos from key-value pairs of ByteStrings and VideoContext.

Parameters:

featureList - List of features to be annotated

Returns:

DoFn performing the necessary operations