org.apache.beam.sdk.extensions.ml

Class VideoIntelligence

java.lang.Object

org.apache.beam.sdk.extensions.ml.VideoIntelligence

@Experimental
public class VideoIntelligence
extends java.lang.Object

Factory class for PTransforms integrating with Google Cloud AI - VideoIntelligence service. Converts GCS URIs of videos or ByteStrings with video contents into Lists of VideoAnnotationResults.

Adding a side input of Maps of elements to VideoContext objects is allowed, so is using KVs of element and VideoContext as input.

Service account with proper permissions is required to use these transforms.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	VideoIntelligence.AnnotateVideoFromBytes A PTransform taking a PCollection of ByteString and an optional side input with a context map and emitting lists of VideoAnnotationResults for each element.
static class	VideoIntelligence.AnnotateVideoFromBytesWithContext A PTransform taking a PCollection of KV of ByteString and VideoContext and emitting lists of VideoAnnotationResults for each element.
static class	VideoIntelligence.AnnotateVideoFromUri A PTransform taking a PCollection of String and an optional side input with a context map and emitting lists of VideoAnnotationResults for each element.
static class	VideoIntelligence.AnnotateVideoFromURIWithContext A PTransform taking a PCollection of KV of String and VideoContext and emitting lists of VideoAnnotationResults for each element.

Constructor Summary

Constructors

Constructor and Description
VideoIntelligence()

Method Summary

Modifier and Type	Method and Description
static VideoIntelligence.AnnotateVideoFromBytes	annotateFromBytes(PCollectionView<java.util.Map<ByteString,com.google.cloud.videointelligence.v1.VideoContext>> contextSideInput, java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList) Annotates videos from ByteStrings of their contents.
static VideoIntelligence.AnnotateVideoFromBytesWithContext	annotateFromBytesWithContext(java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList) Annotates videos from key-value pairs of ByteStrings and VideoContext.
static VideoIntelligence.AnnotateVideoFromUri	annotateFromURI(java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList, PCollectionView<java.util.Map<java.lang.String,com.google.cloud.videointelligence.v1.VideoContext>> contextSideInput) Annotates videos from GCS URIs.
static VideoIntelligence.AnnotateVideoFromURIWithContext	annotateFromUriWithContext(java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList) Annotates videos from key-value pairs of GCS URI and VideoContext.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

VideoIntelligence

public VideoIntelligence()

Method Detail

annotateFromURI

public static VideoIntelligence.AnnotateVideoFromUri annotateFromURI(java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList,
                                                                     PCollectionView<java.util.Map<java.lang.String,com.google.cloud.videointelligence.v1.VideoContext>> contextSideInput)

Annotates videos from GCS URIs.

Parameters:

featureList - List of features to be annotated

contextSideInput - Optional side input with map of contexts to URIs

Returns:

PTransform performing the necessary operations

annotateFromBytes

public static VideoIntelligence.AnnotateVideoFromBytes annotateFromBytes(PCollectionView<java.util.Map<ByteString,com.google.cloud.videointelligence.v1.VideoContext>> contextSideInput,
                                                                         java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList)

Annotates videos from ByteStrings of their contents.

Parameters:

featureList - List of features to be annotated

contextSideInput - Optional side input with map of contexts to ByteStrings

Returns:

PTransform performing the necessary operations

annotateFromUriWithContext

public static VideoIntelligence.AnnotateVideoFromURIWithContext annotateFromUriWithContext(java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList)

Annotates videos from key-value pairs of GCS URI and VideoContext.

Parameters:

featureList - List of features to be annotated

Returns:

PTransform performing the necessary operations

annotateFromBytesWithContext

public static VideoIntelligence.AnnotateVideoFromBytesWithContext annotateFromBytesWithContext(java.util.List<com.google.cloud.videointelligence.v1.Feature> featureList)

Annotates videos from key-value pairs of ByteStrings and VideoContext.

Parameters:

featureList - List of features to be annotated

Returns:

PTransform performing the necessary operations