Package org.apache.beam.runners.dataflow.util

Interface Stager

All Known Implementing Classes:
GcsStager
public interface Stager
Interface for staging files needed for running a Dataflow pipeline.

  • Method Details

    • stageFiles

      List<DataflowPackage> stageFiles(List<PackageUtil.StagedFile> filesToStage)
      Stage files and return a list of packages DataflowPackage objects describing th actual location at which each file was staged.

      The mechanism for staging is owned by the implementation. The only requirement is that the location specified in the returned DataflowPackage should, in fact, contain the contents of the staged file.

    • stageToFile

      DataflowPackage stageToFile(byte[] bytes, String baseName)
      Stage bytes to a target file name wherever this stager stages things.