apache_beam.ml.rag.ingestion.test_utils module

apache_beam.ml.rag.ingestion.test_utils.row_to_chunk(row) → EmbeddableItem

class apache_beam.ml.rag.ingestion.test_utils.ChunkTestUtils

Bases: object

Helper functions for generating test Chunks.

static from_seed(seed: int, content_prefix: str, seed_multiplier: int) → EmbeddableItem

Creates a deterministic Chunk from a seed value.

static get_expected_values(range_start: int, range_end: int, content_prefix: str = 'Testval', seed_multiplier: int = 1) → list[EmbeddableItem]

Returns a range of test Chunks.

class apache_beam.ml.rag.ingestion.test_utils.HashingFn(*unused_args, **unused_kwargs)

Bases: CombineFn

Hashing function for verification.

create_accumulator()

add_input(accumulator, input)

merge_accumulators(accumulators)

extract_output(accumulator)

apache_beam.ml.rag.ingestion.test_utils.generate_expected_hash(num_records: int) → str

apache_beam.ml.rag.ingestion.test_utils.key_on_id(chunk)