apache_beam.testing.benchmarks.nexmark.nexmark_launcher module

Nexmark launcher.

The Nexmark suite is a series of queries (streaming pipelines) performed on a simulation of auction events. The launcher orchestrates the generation and parsing of streaming events and the running of queries.

Model
  • Person: Author of an auction or a bid.
  • Auction: Item under auction.
  • Bid: A bid for an item under auction.
Events
  • Create Person
  • Create Auction
  • Create Bid
Queries
  • Query0: Pass through (send and receive auction events).
Usage
  • DirectRunner
    python nexmark_launcher.py –query/q <query number> –project <project id> –loglevel=DEBUG (optional) –wait_until_finish_duration <time_in_ms> –streaming
  • DataflowRunner
    python nexmark_launcher.py –query/q <query number> –project <project id> –region <GCE region> –loglevel=DEBUG (optional) –wait_until_finish_duration <time_in_ms> –streaming –sdk_location <apache_beam tar.gz> –staging_location=gs://… –temp_location=gs://
class apache_beam.testing.benchmarks.nexmark.nexmark_launcher.NexmarkLauncher[source]

Bases: object

parse_args()[source]
generate_events()[source]
run_query(query, query_args, query_errors)[source]
cleanup()[source]
run()[source]