Package org.apache.iceberg.arrow.vectorized
package org.apache.iceberg.arrow.vectorized
-
ClassDescriptionVectorized reader that returns an iterator of
ColumnarBatch
.ArrowVectorAccessor<DecimalT,Utf8StringT, ArrayT, ChildVectorT extends AutoCloseable> A base BatchReader class that contains common functionalityThis class is inspired by Spark'sColumnarBatch
.This class is inspired by Spark'sColumnVector
.GenericArrowVectorAccessorFactory<DecimalT,Utf8StringT, ArrayT, ChildVectorT extends AutoCloseable> This class is creates typedArrowVectorAccessor
fromVectorHolder
.GenericArrowVectorAccessorFactory.ArrayFactory<ChildVectorT,ArrayT> Create an array value of typeArrayT
from arrow vector value.Create a decimal value of typeDecimalT
from arrow vector value.GenericArrowVectorAccessorFactory.StringFactory<Utf8StringT>Create a UTF8 String value of typeUtf8StringT
from arrow vector value.GenericArrowVectorAccessorFactory.StructChildFactory<ChildVectorT>Create a struct child vector of typeChildVectorT
from arrow vector value.Instances of this class simply track whether a value at an index is null.Container class for holding the Arrow vector storing a batch of values along with other state needed for reading values out of it.A Vector Holder which does not actually produce values, consumers of this class should use the constantValue to populate their ColumnVector implementation.VectorReader(s)
that read in a batch of values into Arrow vectors.A Dummy Vector Reader which doesn't actually read files, instead it returns a dummy VectorHolder which indicates the constant value which should be used for this column.A Dummy Vector Reader which doesn't actually read files.A vectorized implementation of the Iceberg reader that iterates over the table scan.