org.apache.beam.sdk.extensions.sql.meta.provider.text

Class BeamTextCSVTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.provider.text.BeamTextTable

org.apache.beam.sdk.extensions.sql.meta.provider.text.BeamTextCSVTable

All Implemented Interfaces:

java.io.Serializable, BeamSqlTable

public class BeamTextCSVTable
extends BeamTextTable

BeamTextCSVTable is a BeamTextTable which formatted in CSV.

CSVFormat itself has many dialects, check its javadoc for more info.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

rowType

Constructor Summary

Constructors

Constructor and Description
BeamTextCSVTable(RowType beamRowType, java.lang.String filePattern) CSV table with DEFAULT format.
BeamTextCSVTable(RowType rowType, java.lang.String filePattern, org.apache.commons.csv.CSVFormat csvFormat)

Method Summary

Modifier and Type	Method and Description
PCollection<Row>	buildIOReader(Pipeline pipeline) create a PCollection<BeamSqlRow> from source.
PTransform<? super PCollection<Row>,PDone>	buildIOWriter() create a IO.write() instance to write to target.
org.apache.commons.csv.CSVFormat	getCsvFormat()
java.lang.String	getFilePattern()

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.provider.text.BeamTextTable

getSourceType

Methods inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

getRowType

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BeamTextCSVTable

public BeamTextCSVTable(RowType beamRowType,
                        java.lang.String filePattern)

CSV table with DEFAULT format.

BeamTextCSVTable

public BeamTextCSVTable(RowType rowType,
                        java.lang.String filePattern,
                        org.apache.commons.csv.CSVFormat csvFormat)

Method Detail

buildIOReader

public PCollection<Row> buildIOReader(Pipeline pipeline)

Description copied from interface: BeamSqlTable

create a PCollection<BeamSqlRow> from source.

buildIOWriter

public PTransform<? super PCollection<Row>,PDone> buildIOWriter()

Description copied from interface: BeamSqlTable

create a IO.write() instance to write to target.

getCsvFormat

public org.apache.commons.csv.CSVFormat getCsvFormat()

getFilePattern

public java.lang.String getFilePattern()