Skip navigation links

Package org.apache.beam.sdk.io

Defines transforms for reading and writing common storage formats, including AvroIO, and TextIO.

See: Description

Package org.apache.beam.sdk.io Description

Defines transforms for reading and writing common storage formats, including AvroIO, and TextIO.

The classes in this package provide Read transforms that create PCollections from existing storage:


 PCollection<TableRow> inputData = pipeline.apply(
     BigQueryIO.read().from("clouddataflow-readonly:samples.weather_stations"));
 
and Write transforms that persist PCollections to external storage:
 
 PCollection<Integer> numbers = ...;
 numbers.apply(TextIO.write().to("gs://my_bucket/path/to/numbers"));
  
Skip navigation links