apache_beam.testing.benchmarks.nexmark.queries.winning_bids module

A transform to find winning bids for each closed auction. In pseudo CQL syntax:

SELECT Rstream(A.*, B.auction, B.bidder, MAX(B.price), B.dateTime) FROM Auction A [ROWS UNBOUNDED], Bid B [ROWS UNBOUNDED] WHERE A.id = B.auction AND B.datetime < A.expires AND A.expires < CURRENT_TIME GROUP BY A.id

We will also check that the winning bid is above the auction reserve. Note that we ignore the auction opening bid value since it has no impact on which bid eventually wins, if any.

Our implementation will use a custom windowing function in order to bring bids and auctions together without requiring global state.

class apache_beam.testing.benchmarks.nexmark.queries.winning_bids.AuctionOrBidWindow(start, end, auction_id, is_auction_window)

Bases: IntervalWindow

Windows for open auctions and bids.

static for_auction(timestamp, auction)

static for_bid(expected_duration_micro, timestamp, bid)

is_auction_window_fn()

class apache_beam.testing.benchmarks.nexmark.queries.winning_bids.AuctionOrBidWindowCoder

Bases: FastCoder

is_deterministic()

class apache_beam.testing.benchmarks.nexmark.queries.winning_bids.AuctionOrBidWindowCoderImpl

Bases: StreamCoderImpl

encode_to_stream(value, stream, nested)

decode_from_stream(stream, nested)

class apache_beam.testing.benchmarks.nexmark.queries.winning_bids.AuctionOrBidWindowFn(expected_duration_micro)

Bases: WindowFn

assign(assign_context)

merge(merge_context)

get_window_coder()

get_transformed_output_time(window, input_timestamp)

class apache_beam.testing.benchmarks.nexmark.queries.winning_bids.JoinAuctionBidFn(*unused_args, **unused_kwargs)

Bases: DoFn

static higher_bid(bid, other)

process(element)

class apache_beam.testing.benchmarks.nexmark.queries.winning_bids.WinningBids

Bases: PTransform

expand(pcoll)