Package org.apache.beam.sdk.extensions.sorter

Class BufferedExternalSorter

java.lang.Object

org.apache.beam.sdk.extensions.sorter.BufferedExternalSorter

public class BufferedExternalSorter
extends Object

Sorter that will use in memory sorting until the values can't fit into memory and will then fall back to external sorting.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	BufferedExternalSorter.Options	Contains configuration for the sorter.

Method Summary

Modifier and Type	Method	Description
void	add(KV<byte[],byte[]> record)
static BufferedExternalSorter	create(BufferedExternalSorter.Options options)
static BufferedExternalSorter.Options	options()
Iterable<KV<byte[],byte[]>>	sort()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

options

public static BufferedExternalSorter.Options options()

create

public static BufferedExternalSorter create(BufferedExternalSorter.Options options)

add

public void add(KV<byte[],byte[]> record)
         throws IOException

Throws:

IOException

sort

public Iterable<KV<byte[],byte[]>> sort()
                                 throws IOException

Throws:

IOException