Package org.apache.iceberg.data

Class GenericAppenderFactory

java.lang.Object

org.apache.iceberg.data.GenericAppenderFactory

All Implemented Interfaces:

FileAppenderFactory<Record>

public class GenericAppenderFactory
extends Object
implements FileAppenderFactory<Record>

Factory to create a new FileAppender to write Records.

Constructor Summary

Constructors

Constructor	Description
GenericAppenderFactory(Schema schema)
GenericAppenderFactory(Schema schema, PartitionSpec spec)
GenericAppenderFactory(Schema schema, PartitionSpec spec, int[] equalityFieldIds, Schema eqDeleteRowSchema, Schema posDeleteRowSchema)
GenericAppenderFactory(Table table, Schema schema, PartitionSpec spec, Map<String,String> config, int[] equalityFieldIds, Schema eqDeleteRowSchema, Schema posDeleteRowSchema)	Constructor for GenericAppenderFactory.

Method Summary

Modifier and Type	Method	Description
FileAppender<Record>	newAppender(EncryptedOutputFile encryptedOutputFile, FileFormat fileFormat)	Create a new FileAppender.
FileAppender<Record>	newAppender(OutputFile outputFile, FileFormat fileFormat)	Create a new FileAppender.
DataWriter<Record>	newDataWriter(EncryptedOutputFile file, FileFormat format, StructLike partition)	Create a new DataWriter.
EqualityDeleteWriter<Record>	newEqDeleteWriter(EncryptedOutputFile file, FileFormat format, StructLike partition)	Create a new EqualityDeleteWriter.
PositionDeleteWriter<Record>	newPosDeleteWriter(EncryptedOutputFile file, FileFormat format, StructLike partition)	Create a new PositionDeleteWriter.
GenericAppenderFactory	set(String property, String value)
GenericAppenderFactory	setAll(Map<String,String> properties)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

GenericAppenderFactory

public GenericAppenderFactory(Schema schema)

GenericAppenderFactory

public GenericAppenderFactory(Schema schema,
 PartitionSpec spec)

GenericAppenderFactory

public GenericAppenderFactory(Schema schema,
 PartitionSpec spec,
 int[] equalityFieldIds,
 Schema eqDeleteRowSchema,
 Schema posDeleteRowSchema)

GenericAppenderFactory

public GenericAppenderFactory(Table table,
 Schema schema,
 PartitionSpec spec,
 Map<String,String> config,
 int[] equalityFieldIds,
 Schema eqDeleteRowSchema,
 Schema posDeleteRowSchema)

Constructor for GenericAppenderFactory.

Parameters:

table - iceberg table

schema - the schema of the records to write

spec - the partition spec of the records

config - the configuration for the writer

equalityFieldIds - the field ids for equality delete

eqDeleteRowSchema - the schema for equality delete rows

posDeleteRowSchema - the schema for position delete rows

Method Details

set

public GenericAppenderFactory set(String property,
 String value)

setAll

public GenericAppenderFactory setAll(Map<String,String> properties)

newAppender

public FileAppender<Record> newAppender(OutputFile outputFile,
 FileFormat fileFormat)

Description copied from interface: FileAppenderFactory

Create a new FileAppender.

Specified by:

newAppender in interface FileAppenderFactory<Record>

Parameters:

outputFile - an OutputFile used to create an output stream.

fileFormat - File format.

Returns:

a newly created FileAppender

newAppender

public FileAppender<Record> newAppender(EncryptedOutputFile encryptedOutputFile,
 FileFormat fileFormat)

Description copied from interface: FileAppenderFactory

Create a new FileAppender.

Specified by:

newAppender in interface FileAppenderFactory<Record>

Parameters:

encryptedOutputFile - an EncryptedOutputFile used to create an output stream.

fileFormat - File format.

Returns:

a newly created FileAppender

newDataWriter

public DataWriter<Record> newDataWriter(EncryptedOutputFile file,
 FileFormat format,
 StructLike partition)

Description copied from interface: FileAppenderFactory

Create a new DataWriter.

Specified by:

newDataWriter in interface FileAppenderFactory<Record>

Parameters:

file - an OutputFile used to create an output stream.

format - a file format

partition - a tuple of partition values

Returns:

a newly created DataWriter for rows

newEqDeleteWriter

public EqualityDeleteWriter<Record> newEqDeleteWriter(EncryptedOutputFile file,
 FileFormat format,
 StructLike partition)

Description copied from interface: FileAppenderFactory

Create a new EqualityDeleteWriter.

Specified by:

newEqDeleteWriter in interface FileAppenderFactory<Record>

Parameters:

file - an OutputFile used to create an output stream.

format - a file format

partition - a tuple of partition values

Returns:

a newly created EqualityDeleteWriter for equality deletes

newPosDeleteWriter

public PositionDeleteWriter<Record> newPosDeleteWriter(EncryptedOutputFile file,
 FileFormat format,
 StructLike partition)

Description copied from interface: FileAppenderFactory

Create a new PositionDeleteWriter.

Specified by:

newPosDeleteWriter in interface FileAppenderFactory<Record>

Parameters:

file - an OutputFile used to create an output stream.

format - a file format

partition - a tuple of partition values

Returns:

a newly created PositionDeleteWriter for position deletes