Package org.apache.iceberg.data

Class BaseFileWriterFactory<T>

java.lang.Object

org.apache.iceberg.data.BaseFileWriterFactory<T>

All Implemented Interfaces:

FileWriterFactory<T>

public abstract class BaseFileWriterFactory<T>
extends java.lang.Object
implements FileWriterFactory<T>

A base writer factory to be extended by query engine integrations.

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	BaseFileWriterFactory(Table table, FileFormat dataFileFormat, Schema dataSchema, SortOrder dataSortOrder, FileFormat deleteFileFormat, int[] equalityFieldIds, Schema equalityDeleteRowSchema, SortOrder equalityDeleteSortOrder, Schema positionDeleteRowSchema)

Method Summary

Modifier and Type	Method	Description
protected abstract void	configureDataWrite(Avro.DataWriteBuilder builder)
protected abstract void	configureDataWrite(ORC.DataWriteBuilder builder)
protected abstract void	configureDataWrite(Parquet.DataWriteBuilder builder)
protected abstract void	configureEqualityDelete(Avro.DeleteWriteBuilder builder)
protected abstract void	configureEqualityDelete(ORC.DeleteWriteBuilder builder)
protected abstract void	configureEqualityDelete(Parquet.DeleteWriteBuilder builder)
protected abstract void	configurePositionDelete(Avro.DeleteWriteBuilder builder)
protected abstract void	configurePositionDelete(ORC.DeleteWriteBuilder builder)
protected abstract void	configurePositionDelete(Parquet.DeleteWriteBuilder builder)
protected Schema	dataSchema()
protected Schema	equalityDeleteRowSchema()
DataWriter<T>	newDataWriter(EncryptedOutputFile file, PartitionSpec spec, StructLike partition)	Creates a new DataWriter.
EqualityDeleteWriter<T>	newEqualityDeleteWriter(EncryptedOutputFile file, PartitionSpec spec, StructLike partition)	Creates a new EqualityDeleteWriter.
PositionDeleteWriter<T>	newPositionDeleteWriter(EncryptedOutputFile file, PartitionSpec spec, StructLike partition)	Creates a new PositionDeleteWriter.
protected Schema	positionDeleteRowSchema()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BaseFileWriterFactory

protected BaseFileWriterFactory(Table table,
                                FileFormat dataFileFormat,
                                Schema dataSchema,
                                SortOrder dataSortOrder,
                                FileFormat deleteFileFormat,
                                int[] equalityFieldIds,
                                Schema equalityDeleteRowSchema,
                                SortOrder equalityDeleteSortOrder,
                                Schema positionDeleteRowSchema)

Method Detail

configureDataWrite

protected abstract void configureDataWrite(Avro.DataWriteBuilder builder)

configureEqualityDelete

protected abstract void configureEqualityDelete(Avro.DeleteWriteBuilder builder)

configurePositionDelete

protected abstract void configurePositionDelete(Avro.DeleteWriteBuilder builder)

configureDataWrite

protected abstract void configureDataWrite(Parquet.DataWriteBuilder builder)

configureEqualityDelete

protected abstract void configureEqualityDelete(Parquet.DeleteWriteBuilder builder)

configurePositionDelete

protected abstract void configurePositionDelete(Parquet.DeleteWriteBuilder builder)

configureDataWrite

protected abstract void configureDataWrite(ORC.DataWriteBuilder builder)

configureEqualityDelete

protected abstract void configureEqualityDelete(ORC.DeleteWriteBuilder builder)

configurePositionDelete

protected abstract void configurePositionDelete(ORC.DeleteWriteBuilder builder)

newDataWriter

public DataWriter<T> newDataWriter(EncryptedOutputFile file,
                                   PartitionSpec spec,
                                   StructLike partition)

Description copied from interface: FileWriterFactory

Creates a new DataWriter.

Specified by:

newDataWriter in interface FileWriterFactory<T>

Parameters:

file - the output file

spec - the partition spec written data belongs to

partition - the partition written data belongs to or null if the spec is unpartitioned

Returns:

the constructed data writer

newEqualityDeleteWriter

public EqualityDeleteWriter<T> newEqualityDeleteWriter(EncryptedOutputFile file,
                                                       PartitionSpec spec,
                                                       StructLike partition)

Description copied from interface: FileWriterFactory

Creates a new EqualityDeleteWriter.

Specified by:

newEqualityDeleteWriter in interface FileWriterFactory<T>

Parameters:

file - the output file

spec - the partition spec written deletes belong to

partition - the partition written deletes belong to or null if the spec is unpartitioned

Returns:

the constructed equality delete writer

newPositionDeleteWriter

public PositionDeleteWriter<T> newPositionDeleteWriter(EncryptedOutputFile file,
                                                       PartitionSpec spec,
                                                       StructLike partition)

Description copied from interface: FileWriterFactory

Creates a new PositionDeleteWriter.

Specified by:

newPositionDeleteWriter in interface FileWriterFactory<T>

Parameters:

file - the output file

spec - the partition spec written deletes belong to

partition - the partition written deletes belong to or null if the spec is unpartitioned

Returns:

the constructed position delete writer

dataSchema

protected Schema dataSchema()

equalityDeleteRowSchema

protected Schema equalityDeleteRowSchema()

positionDeleteRowSchema

protected Schema positionDeleteRowSchema()