Package org.apache.iceberg.arrow.vectorized

Class VectorizedTableScanIterable

java.lang.Object

org.apache.iceberg.io.CloseableGroup

org.apache.iceberg.arrow.vectorized.VectorizedTableScanIterable

All Implemented Interfaces:

Closeable, AutoCloseable, Iterable<ColumnarBatch>, CloseableIterable<ColumnarBatch>

public class VectorizedTableScanIterable
extends CloseableGroup
implements CloseableIterable<ColumnarBatch>

A vectorized implementation of the Iceberg reader that iterates over the table scan. See ArrowReader for details.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.iceberg.io.CloseableIterable

CloseableIterable.ConcatCloseableIterable<E>

Constructor Summary

Constructors

Constructor	Description
VectorizedTableScanIterable(TableScan scan)	Create a new instance using default values for batchSize and reuseContainers.
VectorizedTableScanIterable(TableScan scan, int batchSize, boolean reuseContainers)	Create a new instance.

Method Summary

Modifier and Type	Method	Description
void	close()	Close all the registered resources.
CloseableIterator<ColumnarBatch>	iterator()	Returns a closeable iterator over elements of type T.

Methods inherited from class org.apache.iceberg.io.CloseableGroup

addCloseable, addCloseable, setSuppressCloseFailure

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Constructor Details

VectorizedTableScanIterable

public VectorizedTableScanIterable(TableScan scan)

Create a new instance using default values for batchSize and reuseContainers. The batchSize is set to BATCH_SIZE_IN_NUM_ROWS and reuseContainers is set to false.

VectorizedTableScanIterable

public VectorizedTableScanIterable(TableScan scan,
 int batchSize,
 boolean reuseContainers)

Create a new instance.

See ArrowReader(TableScan, int, boolean) for details.

Method Details

iterator

public CloseableIterator<ColumnarBatch> iterator()

Description copied from interface: CloseableIterable

Returns a closeable iterator over elements of type T.

Specified by:

iterator in interface CloseableIterable<ColumnarBatch>

Specified by:

iterator in interface Iterable<ColumnarBatch>

Returns:

an CloseableIterator.

close

public void close()
           throws IOException

Description copied from class: CloseableGroup

Close all the registered resources. Close method of each resource will only be called once. Checked exception from AutoCloseable will be wrapped to runtime exception.

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable

Overrides:

close in class CloseableGroup

Throws:

IOException