org.apache.beam.sdk.fn.stream

Class DataStreams

java.lang.Object

org.apache.beam.sdk.fn.stream.DataStreams

public class DataStreams
extends java.lang.Object

inbound(Iterator) treats multiple ByteStrings as a single input stream and outbound(OutputChunkConsumer) treats a single OutputStream as multiple ByteStrings.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DataStreams.BlockingQueueIterator<T> Allows for one or more writing threads to append values to this iterator while one reading thread reads values.
static class	DataStreams.DataStreamDecoder<T> An adapter which converts an InputStream to an Iterator of T values using the specified Coder.
static interface	DataStreams.OutputChunkConsumer<T> Deprecated. Used as a temporary placeholder until implementation of outbound(OutputChunkConsumer).

Constructor Summary

Constructors

Constructor and Description
DataStreams()

Method Summary

Modifier and Type	Method and Description
static java.io.InputStream	inbound(java.util.Iterator<com.google.protobuf.ByteString> bytes) Converts multiple ByteStrings into a single InputStream.
static java.io.OutputStream	outbound(DataStreams.OutputChunkConsumer<com.google.protobuf.ByteString> consumer) Converts a single OutputStream into multiple ByteStrings.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataStreams

public DataStreams()

Method Detail

inbound

public static java.io.InputStream inbound(java.util.Iterator<com.google.protobuf.ByteString> bytes)

Converts multiple ByteStrings into a single InputStream.

The iterator is accessed lazily. The supplied Iterator should block until either it knows that no more values will be provided or it has the next ByteString.

outbound

public static java.io.OutputStream outbound(DataStreams.OutputChunkConsumer<com.google.protobuf.ByteString> consumer)

Converts a single OutputStream into multiple ByteStrings.