Package org.apache.beam.sdk.extensions.sorter

Class ExternalSorter

java.lang.Object

org.apache.beam.sdk.extensions.sorter.ExternalSorter

public abstract class ExternalSorter
extends Object

Does an external sort of the provided values.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ExternalSorter.Options	ExternalSorter.Options contains configuration of the sorter.

Field Summary

Fields

Modifier and Type	Field	Description
protected final ExternalSorter.Options	options

Method Summary

Modifier and Type	Method	Description
void	add(KV<byte[],byte[]> record)	Adds a given record to the sorter.
static ExternalSorter	create(ExternalSorter.Options options)	Returns a Sorter configured with the given ExternalSorter.Options.
Iterable<KV<byte[],byte[]>>	sort()	Sorts the added elements and returns an Iterable over the sorted elements.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

options

protected final ExternalSorter.Options options

Method Details

create

public static ExternalSorter create(ExternalSorter.Options options)

Returns a Sorter configured with the given ExternalSorter.Options.

add

void add(KV<byte[],byte[]> record)
  throws IOException

Adds a given record to the sorter.

Records can only be added before calling sort().

Throws:

IOException

sort

Iterable<KV<byte[],byte[]>> sort()
                          throws IOException

Sorts the added elements and returns an Iterable over the sorted elements.

Can be called at most once.

Throws:

IOException