Package org.apache.iceberg.parquet
Interface VectorizedReader<T>
-
- All Known Implementing Classes:
BaseBatchReader
,ColumnarBatchReader
,VectorizedArrowReader
,VectorizedArrowReader.ConstantVectorReader
public interface VectorizedReader<T>
Interface for vectorized Iceberg readers.
-
-
Method Summary
All Methods Instance Methods Abstract Methods Modifier and Type Method Description void
close()
Release any resources allocated.T
read(T reuse, int numRows)
Reads a batch of type @param <T> and of size numRowsvoid
setBatchSize(int batchSize)
void
setRowGroupInfo(org.apache.parquet.column.page.PageReadStore pages, java.util.Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metadata, long rowPosition)
Sets the row group information to be used with this reader
-
-
-
Method Detail
-
read
T read(T reuse, int numRows)
Reads a batch of type @param <T> and of size numRows- Parameters:
reuse
- container for the last batch to be reused for next batchnumRows
- number of rows to read- Returns:
- batch of records of type @param <T>
-
setBatchSize
void setBatchSize(int batchSize)
-
setRowGroupInfo
void setRowGroupInfo(org.apache.parquet.column.page.PageReadStore pages, java.util.Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metadata, long rowPosition)
Sets the row group information to be used with this reader- Parameters:
pages
- row group information for all the columnsmetadata
- map ofColumnPath
->ColumnChunkMetaData
for the row grouprowPosition
- the row group's row offset in the parquet file
-
close
void close()
Release any resources allocated.
-
-