Package org.apache.beam.sdk.fn.stream

Class DataStreams

java.lang.Object

org.apache.beam.sdk.fn.stream.DataStreams

public class DataStreams
extends Object

DataStreams.DataStreamDecoder treats multiple ByteStrings as a single input stream decoding values with the supplied iterator. outbound(OutputChunkConsumer) treats a single OutputStream as multiple ByteStrings.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	DataStreams.DataStreamDecoder<T>	An adapter which converts an InputStream to a PrefetchableIterator of T values using the specified Coder.
static final class	DataStreams.ElementDelimitedOutputStream	An adapter which wraps an DataStreams.OutputChunkConsumer as an OutputStream.
static interface	DataStreams.OutputChunkConsumer<T>	A callback which is invoked whenever the outbound(org.apache.beam.sdk.fn.stream.DataStreams.OutputChunkConsumer<org.apache.beam.vendor.grpc.v1p69p0.com.google.protobuf.ByteString>) OutputStream becomes full.

Field Summary

Fields

Modifier and Type	Field	Description
static final int	DEFAULT_OUTBOUND_BUFFER_LIMIT_BYTES

Constructor Summary

Constructors

Constructor	Description
DataStreams()

Method Summary

Modifier and Type	Method	Description
static DataStreams.ElementDelimitedOutputStream	outbound(DataStreams.OutputChunkConsumer<org.apache.beam.vendor.grpc.v1p69p0.com.google.protobuf.ByteString> consumer)	Converts a single element delimited OutputStream into multiple ByteStrings.
static DataStreams.ElementDelimitedOutputStream	outbound(DataStreams.OutputChunkConsumer<org.apache.beam.vendor.grpc.v1p69p0.com.google.protobuf.ByteString> consumer, int maximumChunkSize)	Converts a single element delimited OutputStream into multiple ByteStrings using the specified maximum chunk size.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

DEFAULT_OUTBOUND_BUFFER_LIMIT_BYTES

public static final int DEFAULT_OUTBOUND_BUFFER_LIMIT_BYTES

See Also:

• Constant Field Values

Constructor Details

DataStreams

public DataStreams()

Method Details

outbound

public static DataStreams.ElementDelimitedOutputStream outbound(DataStreams.OutputChunkConsumer<org.apache.beam.vendor.grpc.v1p69p0.com.google.protobuf.ByteString> consumer)

Converts a single element delimited OutputStream into multiple ByteStrings.

Note that users must call DataStreams.ElementDelimitedOutputStream.delimitElement() after each element.

Note that this OutputStream follows the Beam Fn API specification for forcing values that encode producing zero bytes to produce exactly one byte.

outbound

public static DataStreams.ElementDelimitedOutputStream outbound(DataStreams.OutputChunkConsumer<org.apache.beam.vendor.grpc.v1p69p0.com.google.protobuf.ByteString> consumer,
 int maximumChunkSize)

Converts a single element delimited OutputStream into multiple ByteStrings using the specified maximum chunk size.

Note that users must call DataStreams.ElementDelimitedOutputStream.delimitElement() after each element.

Note that this OutputStream follows the Beam Fn API specification for forcing values that encode producing zero bytes to produce exactly one byte.