Package org.apache.iceberg.arrow.vectorized

Class VectorizedArrowReader.VectorizedVariantReader

java.lang.Object

org.apache.iceberg.arrow.vectorized.VectorizedArrowReader

org.apache.iceberg.arrow.vectorized.VectorizedArrowReader.VectorizedVariantReader

All Implemented Interfaces:

VectorizedReader<VectorHolder>

Enclosing class:

VectorizedArrowReader

public static class VectorizedArrowReader.VectorizedVariantReader
extends VectorizedArrowReader

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.iceberg.arrow.vectorized.VectorizedArrowReader

VectorizedArrowReader.ConstantVectorReader<T>, VectorizedArrowReader.DeletedVectorReader, VectorizedArrowReader.VectorizedVariantReader

Field Summary

Fields inherited from class org.apache.iceberg.arrow.vectorized.VectorizedArrowReader

DEFAULT_BATCH_SIZE

Constructor Summary

Constructors

Constructor	Description
VectorizedVariantReader(Types.NestedField icebergField, VectorizedArrowReader metadataReader, VectorizedArrowReader valueReader)

Method Summary

Modifier and Type	Method	Description
void	close()	Release any resources allocated.
VectorHolder	read(VectorHolder reuse, int numValsToRead)	Reads a batch of type @param <T> and of size numRows
void	setBatchSize(int batchSize)
void	setRowGroupInfo(org.apache.parquet.column.page.PageReadStore source, Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metadata)	Sets the row group information to be used with this reader
String	toString()

Methods inherited from class org.apache.iceberg.arrow.vectorized.VectorizedArrowReader

icebergField, lastUpdated, nulls, positions, positionsWithSetArrowValidityVector, replaceWithMetadataReader, rowIds

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Details

VectorizedVariantReader

public VectorizedVariantReader(Types.NestedField icebergField,
 VectorizedArrowReader metadataReader,
 VectorizedArrowReader valueReader)

Method Details

read

public VectorHolder read(VectorHolder reuse,
 int numValsToRead)

Description copied from interface: VectorizedReader

Reads a batch of type @param <T> and of size numRows

Specified by:

read in interface VectorizedReader<VectorHolder>

Overrides:

read in class VectorizedArrowReader

Parameters:

reuse - container for the last batch to be reused for next batch

numValsToRead - number of rows to read

Returns:

batch of records of type @param <T>

setRowGroupInfo

public void setRowGroupInfo(org.apache.parquet.column.page.PageReadStore source,
 Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metadata)

Description copied from interface: VectorizedReader

Sets the row group information to be used with this reader

Specified by:

setRowGroupInfo in interface VectorizedReader<VectorHolder>

Overrides:

setRowGroupInfo in class VectorizedArrowReader

Parameters:

source - row group information for all the columns

metadata - map of ColumnPath -> ColumnChunkMetaData for the row group

setBatchSize

public void setBatchSize(int batchSize)

Specified by:

setBatchSize in interface VectorizedReader<VectorHolder>

Overrides:

setBatchSize in class VectorizedArrowReader

close

public void close()

Description copied from interface: VectorizedReader

Release any resources allocated.

Specified by:

close in interface VectorizedReader<VectorHolder>

Overrides:

close in class VectorizedArrowReader

toString

public String toString()

Overrides:

toString in class VectorizedArrowReader