org.apache.iceberg.io

Class OutputFileFactory

java.lang.Object

org.apache.iceberg.io.OutputFileFactory

public class OutputFileFactory
extends java.lang.Object

Factory responsible for generating unique but recognizable data file names.

Constructor Summary

Constructors

Constructor and Description
OutputFileFactory(PartitionSpec spec, FileFormat format, LocationProvider locations, FileIO io, EncryptionManager encryptionManager, int partitionId, long taskId) Constructor where a generated UUID is used as the operationId to ensure uniqueness.
OutputFileFactory(PartitionSpec spec, FileFormat format, LocationProvider locations, FileIO io, EncryptionManager encryptionManager, int partitionId, long taskId, java.lang.String operationId) Constructor with specific operationId.

Method Summary

Modifier and Type	Method and Description
EncryptedOutputFile	newOutputFile() Generates EncryptedOutputFile for UnpartitionedWriter.
EncryptedOutputFile	newOutputFile(PartitionKey key) Generates EncryptedOutputFile for PartitionedWriter.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

OutputFileFactory

public OutputFileFactory(PartitionSpec spec,
                         FileFormat format,
                         LocationProvider locations,
                         FileIO io,
                         EncryptionManager encryptionManager,
                         int partitionId,
                         long taskId)

Constructor where a generated UUID is used as the operationId to ensure uniqueness.

Parameters:

spec - Partition specification used by the location provider

format - File format used for the extension

locations - Location provider used for generating locations

io - FileIO to store the files

encryptionManager - Encryption manager used for encrypting the files

partitionId - First part of the file name

taskId - Second part of the file name

OutputFileFactory

public OutputFileFactory(PartitionSpec spec,
                         FileFormat format,
                         LocationProvider locations,
                         FileIO io,
                         EncryptionManager encryptionManager,
                         int partitionId,
                         long taskId,
                         java.lang.String operationId)

Constructor with specific operationId. The [partitionId, taskId, operationId] triplet has to be unique across JVM instances otherwise the same file name could be generated by different instances of the OutputFileFactory.

Parameters:

spec - Partition specification used by the location provider

format - File format used for the extension

locations - Location provider used for generating locations

io - FileIO to store the files

encryptionManager - Encryption manager used for encrypting the files

partitionId - First part of the file name

taskId - Second part of the file name

operationId - Third part of the file name

Method Detail

newOutputFile

public EncryptedOutputFile newOutputFile()

Generates EncryptedOutputFile for UnpartitionedWriter.

newOutputFile

public EncryptedOutputFile newOutputFile(PartitionKey key)

Generates EncryptedOutputFile for PartitionedWriter.