org.apache.beam.sdk.fn.data

Class BeamFnDataSizeBasedBufferingOutboundObserver<T>

java.lang.Object

org.apache.beam.sdk.fn.data.BeamFnDataSizeBasedBufferingOutboundObserver<T>

All Implemented Interfaces:

java.lang.AutoCloseable, BeamFnDataBufferingOutboundObserver<T>, CloseableFnDataReceiver<T>, FnDataReceiver<T>

Direct Known Subclasses:

BeamFnDataTimeBasedBufferingOutboundObserver

public class BeamFnDataSizeBasedBufferingOutboundObserver<T>
extends java.lang.Object
implements BeamFnDataBufferingOutboundObserver<T>

A size-based buffering outbound FnDataReceiver for the Beam Fn Data API.

TODO: Handle outputting large elements (> 2GiBs). Note that this also applies to the input side as well.

TODO: Handle outputting elements that are zero bytes by outputting a single byte as a marker, detect on the input side that no bytes were read and force reading a single byte.

Field Summary

Fields inherited from interface org.apache.beam.sdk.fn.data.BeamFnDataBufferingOutboundObserver

BEAM_FN_API_DATA_BUFFER_LIMIT, BEAM_FN_API_DATA_BUFFER_SIZE_LIMIT, BEAM_FN_API_DATA_BUFFER_TIME_LIMIT, DEFAULT_BUFFER_LIMIT_BYTES, DEFAULT_BUFFER_LIMIT_TIME_MS

Method Summary

Modifier and Type	Method and Description
void	accept(T t)
void	close() .
void	flush() Eagerly flushes any data that is buffered in this channel.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.beam.sdk.fn.data.BeamFnDataBufferingOutboundObserver

forLocation, getSizeLimit, getTimeLimit

Method Detail

close

public void close()
           throws java.lang.Exception

Description copied from interface: CloseableFnDataReceiver

.

Does nothing if this CloseableFnDataReceiver is already closed.

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface CloseableFnDataReceiver<T>

Throws:

java.lang.Exception

flush

public void flush()
           throws java.io.IOException

Description copied from interface: CloseableFnDataReceiver

Eagerly flushes any data that is buffered in this channel.

Specified by:

flush in interface CloseableFnDataReceiver<T>

Throws:

java.io.IOException

accept

public void accept(T t)
            throws java.io.IOException

Specified by:

accept in interface FnDataReceiver<T>

Throws:

java.io.IOException