Interface | Description |
---|---|
CloseableIterable<T> | |
CloseableIterator<T> | |
CredentialSupplier |
Interface used to expose credentials held by a FileIO instance.
|
DelegateFileIO |
This interface is intended as an extension for FileIO implementations that support being a
delegate target.
|
DelegatingInputStream | |
DelegatingOutputStream | |
EqualityDeltaWriter<T> |
A writer capable of writing data and equality deletes that may belong to different specs and
partitions.
|
FileAppender<D> | |
FileAppenderFactory<T> |
Factory to create a new
FileAppender to write records. |
FileIO |
Pluggable module for reading, writing, and deleting files.
|
FileIOMetricsContext |
Extension of MetricsContext for use with FileIO to define standard metrics that should be
reported.
|
FileWriter<T,R> |
A writer capable of writing files of a single type (i.e.
|
FileWriterFactory<T> |
A factory for creating data and delete writers.
|
InputFile |
An interface used to read input files using
SeekableInputStream instances. |
LocationProvider |
Interface for providing data file locations to write tasks.
|
OutputFile |
An interface used to create output files using
PositionOutputStream instances. |
PartitioningWriter<T,R> |
A writer capable of writing files of a single type (i.e.
|
PositionDeltaWriter<T> |
A writer capable of writing data and position deletes that may belong to different specs and
partitions.
|
RangeReadable |
RangeReadable is an interface that allows for implementations of InputFile
streams to perform positional, range-based reads, which are more efficient than unbounded reads
in many cloud provider object stores. |
SupportsBulkOperations | |
SupportsPrefixOperations |
This interface is intended as an extension for FileIO implementations to provide additional
prefix based operations that may be useful in performing supporting operations.
|
TaskWriter<T> |
The writer interface could accept records and provide the generated data files.
|
Class | Description |
---|---|
BasePositionDeltaWriter<T> | |
BaseTaskWriter<T> | |
ByteBufferInputStream | |
CloseableGroup |
This class acts as a helper for handling the closure of multiple resource.
|
CloseableIterable.ConcatCloseableIterable<E> | |
ClosingIterator<T> |
A convenience wrapper around
CloseableIterator , providing auto-close functionality when
all of the elements in the iterator are consumed. |
ClusteredDataWriter<T> |
A data writer capable of writing to multiple specs and partitions that requires the incoming
records to be properly clustered by partition spec and by partition within each spec.
|
ClusteredEqualityDeleteWriter<T> |
An equality delete writer capable of writing to multiple specs and partitions that requires the
incoming delete records to be properly clustered by partition spec and by partition within each
spec.
|
ClusteredPositionDeleteWriter<T> |
A position delete writer capable of writing to multiple specs and partitions that requires the
incoming delete records to be properly clustered by partition spec and by partition within each
spec.
|
ContentCache |
Class that provides file-content caching during reading.
|
DataWriter<T> | |
DataWriteResult |
A result of writing data files.
|
DeleteSchemaUtil | |
DeleteWriteResult |
A result of writing delete files.
|
FanoutDataWriter<T> |
A data writer capable of writing to multiple specs and partitions that keeps data writers for
each seen spec/partition pair open until this writer is closed.
|
FanoutPositionOnlyDeleteWriter<T> |
A position delete writer capable of writing to multiple specs and partitions if the incoming
stream of deletes is not ordered.
|
FileInfo | |
FileIOParser | |
FilterIterator<T> |
An Iterator that filters another Iterator.
|
IOUtil | |
OutputFileFactory |
Factory responsible for generating unique but recognizable data/delete file names.
|
OutputFileFactory.Builder | |
PartitionedFanoutWriter<T> | |
PartitionedWriter<T> | |
PositionOutputStream | |
ResolvingFileIO |
FileIO implementation that uses location scheme to choose the correct FileIO implementation.
|
RollingDataWriter<T> |
A rolling data writer that splits incoming data into multiple files within one spec/partition
based on the target file size.
|
RollingEqualityDeleteWriter<T> |
A rolling equality delete writer that splits incoming deletes into multiple files within one
spec/partition based on the target file size.
|
RollingPositionDeleteWriter<T> |
A rolling position delete writer that splits incoming deletes into multiple files within one
spec/partition based on the target file size.
|
SeekableInputStream |
SeekableInputStream is an interface with the methods needed to read data from a file or
Hadoop data stream. |
UnpartitionedWriter<T> | |
WriteResult | |
WriteResult.Builder |
Exception | Description |
---|---|
BulkDeletionFailureException |