Class BaseBatchReader<T>
- java.lang.Object
-
- org.apache.iceberg.arrow.vectorized.BaseBatchReader<T>
-
- All Implemented Interfaces:
VectorizedReader<T>
- Direct Known Subclasses:
ColumnarBatchReader
public abstract class BaseBatchReader<T> extends java.lang.Object implements VectorizedReader<T>
A base BatchReader class that contains common functionality
-
-
Field Summary
Fields Modifier and Type Field Description protected VectorizedArrowReader[]readersprotected VectorHolder[]vectorHolders
-
Constructor Summary
Constructors Modifier Constructor Description protectedBaseBatchReader(java.util.List<VectorizedReader<?>> readers)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description voidclose()Release any resources allocated.protected voidcloseVectors()voidsetBatchSize(int batchSize)voidsetRowGroupInfo(org.apache.parquet.column.page.PageReadStore pageStore, java.util.Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metaData, long rowPosition)Sets the row group information to be used with this reader-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
Methods inherited from interface org.apache.iceberg.parquet.VectorizedReader
read
-
-
-
-
Field Detail
-
readers
protected final VectorizedArrowReader[] readers
-
vectorHolders
protected final VectorHolder[] vectorHolders
-
-
Constructor Detail
-
BaseBatchReader
protected BaseBatchReader(java.util.List<VectorizedReader<?>> readers)
-
-
Method Detail
-
setRowGroupInfo
public void setRowGroupInfo(org.apache.parquet.column.page.PageReadStore pageStore, java.util.Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metaData, long rowPosition)Description copied from interface:VectorizedReaderSets the row group information to be used with this reader- Specified by:
setRowGroupInfoin interfaceVectorizedReader<T>- Parameters:
pageStore- row group information for all the columnsmetaData- map ofColumnPath->ColumnChunkMetaDatafor the row grouprowPosition- the row group's row offset in the parquet file
-
closeVectors
protected void closeVectors()
-
close
public void close()
Description copied from interface:VectorizedReaderRelease any resources allocated.- Specified by:
closein interfaceVectorizedReader<T>
-
setBatchSize
public void setBatchSize(int batchSize)
- Specified by:
setBatchSizein interfaceVectorizedReader<T>
-
-