Class BaseBatchReader<T>
- java.lang.Object
-
- org.apache.iceberg.arrow.vectorized.BaseBatchReader<T>
-
- All Implemented Interfaces:
VectorizedReader<T>
- Direct Known Subclasses:
ColumnarBatchReader
public abstract class BaseBatchReader<T> extends java.lang.Object implements VectorizedReader<T>
A base BatchReader class that contains common functionality
-
-
Field Summary
Fields Modifier and Type Field Description protected VectorizedArrowReader[]
readers
protected VectorHolder[]
vectorHolders
-
Constructor Summary
Constructors Modifier Constructor Description protected
BaseBatchReader(java.util.List<VectorizedReader<?>> readers)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description void
close()
Release any resources allocated.protected void
closeVectors()
void
setBatchSize(int batchSize)
void
setRowGroupInfo(org.apache.parquet.column.page.PageReadStore pageStore, java.util.Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metaData, long rowPosition)
Sets the row group information to be used with this reader-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
Methods inherited from interface org.apache.iceberg.parquet.VectorizedReader
read
-
-
-
-
Field Detail
-
readers
protected final VectorizedArrowReader[] readers
-
vectorHolders
protected final VectorHolder[] vectorHolders
-
-
Constructor Detail
-
BaseBatchReader
protected BaseBatchReader(java.util.List<VectorizedReader<?>> readers)
-
-
Method Detail
-
setRowGroupInfo
public void setRowGroupInfo(org.apache.parquet.column.page.PageReadStore pageStore, java.util.Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metaData, long rowPosition)
Description copied from interface:VectorizedReader
Sets the row group information to be used with this reader- Specified by:
setRowGroupInfo
in interfaceVectorizedReader<T>
- Parameters:
pageStore
- row group information for all the columnsmetaData
- map ofColumnPath
->ColumnChunkMetaData
for the row grouprowPosition
- the row group's row offset in the parquet file
-
closeVectors
protected void closeVectors()
-
close
public void close()
Description copied from interface:VectorizedReader
Release any resources allocated.- Specified by:
close
in interfaceVectorizedReader<T>
-
setBatchSize
public void setBatchSize(int batchSize)
- Specified by:
setBatchSize
in interfaceVectorizedReader<T>
-
-