org.apache.beam.sdk.extensions.sql.impl.schema.text

Class BeamTextCSVTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

org.apache.beam.sdk.extensions.sql.impl.schema.text.BeamTextTable

org.apache.beam.sdk.extensions.sql.impl.schema.text.BeamTextCSVTable

All Implemented Interfaces:

java.io.Serializable, BeamSqlTable

public class BeamTextCSVTable
extends BeamTextTable

BeamTextCSVTable is a BeamTextTable which formatted in CSV.

CSVFormat itself has many dialects, check its javadoc for more info.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.text.BeamTextTable

filePattern

Fields inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

beamSqlRowType

Constructor Summary

Constructors

Constructor and Description
BeamTextCSVTable(BeamRecordSqlType beamSqlRowType, java.lang.String filePattern) CSV table with DEFAULT format.
BeamTextCSVTable(BeamRecordSqlType beamSqlRowType, java.lang.String filePattern, CSVFormat csvFormat)

Method Summary

Modifier and Type	Method and Description
PCollection<BeamRecord>	buildIOReader(Pipeline pipeline) create a PCollection<BeamSqlRow> from source.
PTransform<? super PCollection<BeamRecord>,PDone>	buildIOWriter() create a IO.write() instance to write to target.

Methods inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.text.BeamTextTable

getSourceType

Methods inherited from class org.apache.beam.sdk.extensions.sql.impl.schema.BaseBeamTable

getRowType

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BeamTextCSVTable

public BeamTextCSVTable(BeamRecordSqlType beamSqlRowType,
                        java.lang.String filePattern)

CSV table with DEFAULT format.

BeamTextCSVTable

public BeamTextCSVTable(BeamRecordSqlType beamSqlRowType,
                        java.lang.String filePattern,
                        CSVFormat csvFormat)

Method Detail

buildIOReader

public PCollection<BeamRecord> buildIOReader(Pipeline pipeline)

Description copied from interface: BeamSqlTable

create a PCollection<BeamSqlRow> from source.

buildIOWriter

public PTransform<? super PCollection<BeamRecord>,PDone> buildIOWriter()

Description copied from interface: BeamSqlTable

create a IO.write() instance to write to target.