Package org.apache.iceberg.arrow.vectorized

Class BaseBatchReader<T>

java.lang.Object

org.apache.iceberg.arrow.vectorized.BaseBatchReader<T>

All Implemented Interfaces:

VectorizedReader<T>

Direct Known Subclasses:

ColumnarBatchReader

public abstract class BaseBatchReader<T>
extends Object
implements VectorizedReader<T>

A base BatchReader class that contains common functionality

Field Summary

Fields

Modifier and Type	Field	Description
protected final VectorizedArrowReader[]	readers
protected final VectorHolder[]	vectorHolders

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	BaseBatchReader(List<VectorizedReader<?>> readers)

Method Summary

Modifier and Type	Method	Description
void	close()	Release any resources allocated.
protected void	closeVectors()
void	setBatchSize(int batchSize)
void	setRowGroupInfo(org.apache.parquet.column.page.PageReadStore pageStore, Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metaData, long rowPosition)	Sets the row group information to be used with this reader

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.iceberg.parquet.VectorizedReader

read

Field Details

readers

protected final VectorizedArrowReader[] readers

vectorHolders

protected final VectorHolder[] vectorHolders

Constructor Details

BaseBatchReader

protected BaseBatchReader(List<VectorizedReader<?>> readers)

Method Details

setRowGroupInfo

public void setRowGroupInfo(org.apache.parquet.column.page.PageReadStore pageStore,
 Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metaData,
 long rowPosition)

Description copied from interface: VectorizedReader

Sets the row group information to be used with this reader

Specified by:

setRowGroupInfo in interface VectorizedReader<T>

Parameters:

pageStore - row group information for all the columns

metaData - map of ColumnPath -> ColumnChunkMetaData for the row group

rowPosition - the row group's row offset in the parquet file

closeVectors

protected void closeVectors()

close

public void close()

Description copied from interface: VectorizedReader

Release any resources allocated.

Specified by:

close in interface VectorizedReader<T>

setBatchSize

public void setBatchSize(int batchSize)

Specified by:

setBatchSize in interface VectorizedReader<T>