org.apache.beam.sdk.io.fileschematransform

Class FileWriteSchemaTransformConfiguration.CsvConfiguration

java.lang.Object

org.apache.beam.sdk.io.fileschematransform.FileWriteSchemaTransformConfiguration.CsvConfiguration

Enclosing class:

FileWriteSchemaTransformConfiguration

@DefaultSchema(value=AutoValueSchema.class)
public abstract static class FileWriteSchemaTransformConfiguration.CsvConfiguration
extends java.lang.Object

Configures extra details related to writing CSV formatted files.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	FileWriteSchemaTransformConfiguration.CsvConfiguration.Builder

Constructor Summary

Constructors

Constructor and Description
CsvConfiguration()

Method Summary

Modifier and Type	Method and Description
abstract java.lang.String	getCsvFormat() The format of the written CSV file.
abstract java.lang.String	getPreamble() Not to be confused with the CSV header, it is content written to the top of every sharded file prior to the header.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CsvConfiguration

public CsvConfiguration()

Method Detail

getPreamble

@Nullable
public abstract java.lang.String getPreamble()

Not to be confused with the CSV header, it is content written to the top of every sharded file prior to the header. In the example below, all the text proceeding the header 'column1,column2,column3' is the preamble.

Fake company, Inc. Lab experiment: abcdefg123456 Experiment date: 2022-12-05 Operator: John Doe

column1,column2,column3 1,2,3 4,5,6

getCsvFormat

public abstract java.lang.String getCsvFormat()

The format of the written CSV file. See org.apache.commons.csv.CSVFormat for allowed values, stringified in lowercase. Defaults to CSVFormat.DEFAULT