org.apache.beam.sdk.extensions.sql.meta.provider.text

Class BeamTextCSVTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.provider.text.BeamTextTable

org.apache.beam.sdk.extensions.sql.meta.provider.text.BeamTextCSVTable

All Implemented Interfaces:

java.io.Serializable, BeamSqlTable

public class BeamTextCSVTable
extends BeamTextTable

BeamTextCSVTable is a BeamTextTable which formatted in CSV.

CSVFormat itself has many dialects, check its javadoc for more info.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

schema

Constructor Summary

Constructors

Constructor and Description
BeamTextCSVTable(Schema beamSchema, java.lang.String filePattern) CSV table with DEFAULT format.
BeamTextCSVTable(Schema schema, java.lang.String filePattern, org.apache.commons.csv.CSVFormat csvFormat)

Method Summary

Modifier and Type	Method and Description
PCollection<Row>	buildIOReader(Pipeline pipeline) create a PCollection<BeamSqlRow> from source.
PTransform<? super PCollection<Row>,POutput>	buildIOWriter() create a IO.write() instance to write to target.
org.apache.commons.csv.CSVFormat	getCsvFormat()
java.lang.String	getFilePattern()

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.provider.text.BeamTextTable

getSourceType

Methods inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

getSchema

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BeamTextCSVTable

public BeamTextCSVTable(Schema beamSchema,
                        java.lang.String filePattern)

CSV table with DEFAULT format.

BeamTextCSVTable

public BeamTextCSVTable(Schema schema,
                        java.lang.String filePattern,
                        org.apache.commons.csv.CSVFormat csvFormat)

Method Detail

buildIOReader

public PCollection<Row> buildIOReader(Pipeline pipeline)

Description copied from interface: BeamSqlTable

create a PCollection<BeamSqlRow> from source.

buildIOWriter

public PTransform<? super PCollection<Row>,POutput> buildIOWriter()

Description copied from interface: BeamSqlTable

create a IO.write() instance to write to target.

getCsvFormat

public org.apache.commons.csv.CSVFormat getCsvFormat()

getFilePattern

public java.lang.String getFilePattern()