Package org.apache.iceberg.data

Class RegistryBasedFileWriterFactory<T,S>

java.lang.Object

org.apache.iceberg.data.RegistryBasedFileWriterFactory<T,S>

Type Parameters:

T - row type

All Implemented Interfaces:

Serializable, FileWriterFactory<T>

Direct Known Subclasses:

FlinkFileWriterFactory, GenericFileWriterFactory

public abstract class RegistryBasedFileWriterFactory<T,S>
extends Object
implements FileWriterFactory<T>, Serializable

A base writer factory to be extended by query engine integrations.

See Also:

• Serialized Form

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	RegistryBasedFileWriterFactory(Table table, FileFormat dataFileFormat, Class<T> inputType, Schema dataSchema, SortOrder dataSortOrder, FileFormat deleteFileFormat, int[] equalityFieldIds, Schema equalityDeleteRowSchema, SortOrder equalityDeleteSortOrder, Map<String,String> writerProperties, S inputSchema, S equalityDeleteInputSchema)

Method Summary

Modifier and Type	Method	Description
protected S	equalityDeleteInputSchema()
protected S	inputSchema()
DataWriter<T>	newDataWriter(EncryptedOutputFile file, PartitionSpec spec, StructLike partition)	Creates a new DataWriter.
EqualityDeleteWriter<T>	newEqualityDeleteWriter(EncryptedOutputFile file, PartitionSpec spec, StructLike partition)	Creates a new EqualityDeleteWriter.
PositionDeleteWriter<T>	newPositionDeleteWriter(EncryptedOutputFile file, PartitionSpec spec, StructLike partition)	Creates a new PositionDeleteWriter.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

RegistryBasedFileWriterFactory

protected RegistryBasedFileWriterFactory(Table table,
 FileFormat dataFileFormat,
 Class<T> inputType,
 Schema dataSchema,
 SortOrder dataSortOrder,
 FileFormat deleteFileFormat,
 int[] equalityFieldIds,
 Schema equalityDeleteRowSchema,
 SortOrder equalityDeleteSortOrder,
 Map<String,String> writerProperties,
 S inputSchema,
 S equalityDeleteInputSchema)

Method Details

inputSchema

protected S inputSchema()

equalityDeleteInputSchema

protected S equalityDeleteInputSchema()

newDataWriter

public DataWriter<T> newDataWriter(EncryptedOutputFile file,
 PartitionSpec spec,
 StructLike partition)

Description copied from interface: FileWriterFactory

Creates a new DataWriter.

Specified by:

newDataWriter in interface FileWriterFactory<T>

Parameters:

file - the output file

spec - the partition spec written data belongs to

partition - the partition written data belongs to or null if the spec is unpartitioned

Returns:

the constructed data writer

newEqualityDeleteWriter

public EqualityDeleteWriter<T> newEqualityDeleteWriter(EncryptedOutputFile file,
 PartitionSpec spec,
 StructLike partition)

Description copied from interface: FileWriterFactory

Creates a new EqualityDeleteWriter.

Specified by:

newEqualityDeleteWriter in interface FileWriterFactory<T>

Parameters:

file - the output file

spec - the partition spec written deletes belong to

partition - the partition written deletes belong to or null if the spec is unpartitioned

Returns:

the constructed equality delete writer

newPositionDeleteWriter

public PositionDeleteWriter<T> newPositionDeleteWriter(EncryptedOutputFile file,
 PartitionSpec spec,
 StructLike partition)

Description copied from interface: FileWriterFactory

Creates a new PositionDeleteWriter.

Specified by:

newPositionDeleteWriter in interface FileWriterFactory<T>

Parameters:

file - the output file

spec - the partition spec written deletes belong to

partition - the partition written deletes belong to or null if the spec is unpartitioned

Returns:

the constructed position delete writer