Package org.apache.iceberg.arrow.vectorized.parquet

Class VectorizedColumnIterator

java.lang.Object

org.apache.iceberg.parquet.BaseColumnIterator

org.apache.iceberg.arrow.vectorized.parquet.VectorizedColumnIterator

public class VectorizedColumnIterator
extends BaseColumnIterator

Vectorized version of the ColumnIterator that reads column values in data pages of a column in a row group in a batched fashion.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
class	VectorizedColumnIterator.BatchReader
class	VectorizedColumnIterator.BooleanBatchReader
class	VectorizedColumnIterator.DictionaryBatchReader
class	VectorizedColumnIterator.DoubleBatchReader
class	VectorizedColumnIterator.FixedSizeBinaryBatchReader
class	VectorizedColumnIterator.FixedWidthTypeBinaryBatchReader	Deprecated. since 1.7.0, will be removed in 1.8.0.
class	VectorizedColumnIterator.FloatBatchReader
class	VectorizedColumnIterator.IntegerBatchReader
class	VectorizedColumnIterator.LongBatchReader
class	VectorizedColumnIterator.TimestampInt96BatchReader
class	VectorizedColumnIterator.TimestampMillisBatchReader
class	VectorizedColumnIterator.VarWidthTypeBatchReader

Field Summary

Fields inherited from class org.apache.iceberg.parquet.BaseColumnIterator

advanceNextPageCount, desc, dictionary, pageSource, triplesCount, triplesRead

Constructor Summary

Constructors

Constructor	Description
VectorizedColumnIterator(org.apache.parquet.column.ColumnDescriptor desc, java.lang.String writerVersion, boolean setArrowValidityVector)

Method Summary

Modifier and Type	Method	Description
VectorizedColumnIterator.BooleanBatchReader	booleanBatchReader()
VectorizedColumnIterator.DictionaryBatchReader	dictionaryBatchReader()
VectorizedColumnIterator.DoubleBatchReader	doubleBatchReader()
VectorizedColumnIterator.FixedSizeBinaryBatchReader	fixedSizeBinaryBatchReader()
VectorizedColumnIterator.FixedWidthTypeBinaryBatchReader	fixedWidthTypeBinaryBatchReader()	Deprecated. since 1.7.0, will be removed in 1.8.0.
VectorizedColumnIterator.FloatBatchReader	floatBatchReader()
VectorizedColumnIterator.IntegerBatchReader	integerBatchReader()
VectorizedColumnIterator.LongBatchReader	longBatchReader()
protected BasePageIterator	pageIterator()
boolean	producesDictionaryEncodedVector()
void	setBatchSize(int batchSize)
org.apache.parquet.column.Dictionary	setRowGroupInfo(org.apache.parquet.column.page.PageReader store, boolean allPagesDictEncoded)
VectorizedColumnIterator.TimestampInt96BatchReader	timestampInt96BatchReader()
VectorizedColumnIterator.TimestampMillisBatchReader	timestampMillisBatchReader()
VectorizedColumnIterator.VarWidthTypeBatchReader	varWidthTypeBatchReader()

Methods inherited from class org.apache.iceberg.parquet.BaseColumnIterator

advance, hasNext, setPageSource

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

VectorizedColumnIterator

public VectorizedColumnIterator(org.apache.parquet.column.ColumnDescriptor desc,
                                java.lang.String writerVersion,
                                boolean setArrowValidityVector)

Method Detail

setBatchSize

public void setBatchSize(int batchSize)

setRowGroupInfo

public org.apache.parquet.column.Dictionary setRowGroupInfo(org.apache.parquet.column.page.PageReader store,
                                                            boolean allPagesDictEncoded)

pageIterator

protected BasePageIterator pageIterator()

Specified by:

pageIterator in class BaseColumnIterator

producesDictionaryEncodedVector

public boolean producesDictionaryEncodedVector()

integerBatchReader

public VectorizedColumnIterator.IntegerBatchReader integerBatchReader()

dictionaryBatchReader

public VectorizedColumnIterator.DictionaryBatchReader dictionaryBatchReader()

longBatchReader

public VectorizedColumnIterator.LongBatchReader longBatchReader()

timestampMillisBatchReader

public VectorizedColumnIterator.TimestampMillisBatchReader timestampMillisBatchReader()

timestampInt96BatchReader

public VectorizedColumnIterator.TimestampInt96BatchReader timestampInt96BatchReader()

floatBatchReader

public VectorizedColumnIterator.FloatBatchReader floatBatchReader()

doubleBatchReader

public VectorizedColumnIterator.DoubleBatchReader doubleBatchReader()

fixedSizeBinaryBatchReader

public VectorizedColumnIterator.FixedSizeBinaryBatchReader fixedSizeBinaryBatchReader()

varWidthTypeBatchReader

public VectorizedColumnIterator.VarWidthTypeBatchReader varWidthTypeBatchReader()

fixedWidthTypeBinaryBatchReader

@Deprecated
public VectorizedColumnIterator.FixedWidthTypeBinaryBatchReader fixedWidthTypeBinaryBatchReader()

Deprecated.

since 1.7.0, will be removed in 1.8.0.

booleanBatchReader

public VectorizedColumnIterator.BooleanBatchReader booleanBatchReader()