apache_beam.ml.rag.chunking package

Chunking components for RAG pipelines. This module provides components for splitting text into chunks for RAG pipelines.

Submodules

• apache_beam.ml.rag.chunking.base module
  • ChunkingTransformProvider
    • ChunkingTransformProvider.get_splitter_transform()
    • ChunkingTransformProvider.get_ptransform_for_processing()
• apache_beam.ml.rag.chunking.langchain module
  • LangChainChunker
    • LangChainChunker.get_splitter_transform()