Package org.apache.iceberg.io

Class BaseTaskWriter<T>

java.lang.Object

org.apache.iceberg.io.BaseTaskWriter<T>

All Implemented Interfaces:

Closeable, AutoCloseable, TaskWriter<T>

Direct Known Subclasses:

PartitionedFanoutWriter, PartitionedWriter, UnpartitionedWriter

public abstract class BaseTaskWriter<T>
extends Object
implements TaskWriter<T>

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
protected class	BaseTaskWriter.BaseEqualityDeltaWriter	Base equality delta writer to write both insert records and equality-deletes.
protected class	BaseTaskWriter.RollingEqDeleteWriter
protected class	BaseTaskWriter.RollingFileWriter

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	BaseTaskWriter(PartitionSpec spec, FileFormat format, FileAppenderFactory<T> appenderFactory, OutputFileFactory fileFactory, FileIO io, long targetFileSize)
protected	BaseTaskWriter(PartitionSpec spec, FileFormat format, FileWriterFactory<T> writerFactory, OutputFileFactory fileFactory, FileIO io, long targetFileSize)
protected	BaseTaskWriter(PartitionSpec spec, FileFormat format, FileWriterFactory<T> writerFactory, OutputFileFactory fileFactory, FileIO io, long targetFileSize, boolean useDv)

Method Summary

Modifier and Type	Method	Description
void	abort()	Close the writer and delete the completed files if possible when aborting.
void	close()
WriteResult	complete()	Close the writer and get the completed data and delete files.
protected PartitioningDVWriter<T>	dvFileWriter()
protected void	setFailure(Throwable throwable)
protected PartitionSpec	spec()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.iceberg.io.TaskWriter

dataFiles, write

Constructor Details

BaseTaskWriter

protected BaseTaskWriter(PartitionSpec spec,
 FileFormat format,
 FileAppenderFactory<T> appenderFactory,
 OutputFileFactory fileFactory,
 FileIO io,
 long targetFileSize)

BaseTaskWriter

protected BaseTaskWriter(PartitionSpec spec,
 FileFormat format,
 FileWriterFactory<T> writerFactory,
 OutputFileFactory fileFactory,
 FileIO io,
 long targetFileSize)

BaseTaskWriter

protected BaseTaskWriter(PartitionSpec spec,
 FileFormat format,
 FileWriterFactory<T> writerFactory,
 OutputFileFactory fileFactory,
 FileIO io,
 long targetFileSize,
 boolean useDv)

Method Details

spec

protected PartitionSpec spec()

setFailure

protected void setFailure(Throwable throwable)

dvFileWriter

protected PartitioningDVWriter<T> dvFileWriter()

abort

public void abort()
           throws IOException

Description copied from interface: TaskWriter

Close the writer and delete the completed files if possible when aborting.

Specified by:

abort in interface TaskWriter<T>

Throws:

IOException - if any IO error happen.

complete

public WriteResult complete()
                     throws IOException

Description copied from interface: TaskWriter

Close the writer and get the completed data and delete files.

Specified by:

complete in interface TaskWriter<T>

Returns:

the completed data and delete files of this task writer.

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Throws:

IOException