apache_beam.ml.rag package

Apache Beam RAG (Retrieval Augmented Generation) components. This package provides components for building RAG pipelines in Apache Beam, including: - Chunking - Embedding generation - Vector storage - Vector search enrichment

Subpackages

• apache_beam.ml.rag.chunking package
  • Submodules
    • apache_beam.ml.rag.chunking.base module
      • ChunkingTransformProvider
    • apache_beam.ml.rag.chunking.langchain module
      • LangChainChunker
• apache_beam.ml.rag.embeddings package
  • Submodules
    • apache_beam.ml.rag.embeddings.base module
      • create_rag_adapter()
    • apache_beam.ml.rag.embeddings.huggingface module
      • HuggingfaceTextEmbeddings

Submodules

• apache_beam.ml.rag.types module
  • Content
    • Content.text
  • Embedding
    • Embedding.dense_embedding
    • Embedding.sparse_embedding
  • Chunk
    • Chunk.content
    • Chunk.id
    • Chunk.index
    • Chunk.metadata
    • Chunk.embedding