Package org.apache.iceberg.parquet

Interface VectorizedReader<T>

All Known Implementing Classes:
BaseBatchReader, ColumnarBatchReader, VectorizedArrowReader, VectorizedArrowReader.ConstantVectorReader, VectorizedArrowReader.DeletedVectorReader
public interface VectorizedReader<T>
Interface for vectorized Iceberg readers.

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    close()
    Release any resources allocated.
    T
    read(T reuse, int numRows)
    Reads a batch of type @param <T> and of size numRows
    void
    setBatchSize(int batchSize)
     
    default void
    setRowGroupInfo(org.apache.parquet.column.page.PageReadStore pages, Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metadata)
    Sets the row group information to be used with this reader
    void
    setRowGroupInfo(org.apache.parquet.column.page.PageReadStore pages, Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metadata, long rowPosition)
    Deprecated.
    since 1.8.0, will be removed in 1.9.0; use setRowGroupInfo(PageReadStore, Map) instead.

  • Method Details

    • read

      T read(T reuse, int numRows)
      Reads a batch of type @param <T> and of size numRows
      Parameters:
      reuse - container for the last batch to be reused for next batch
      numRows - number of rows to read
      Returns:
      batch of records of type @param <T>

    • setBatchSize

      void setBatchSize(int batchSize)

    • setRowGroupInfo

      @Deprecated void setRowGroupInfo(org.apache.parquet.column.page.PageReadStore pages, Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metadata, long rowPosition)
      Deprecated.
      since 1.8.0, will be removed in 1.9.0; use setRowGroupInfo(PageReadStore, Map) instead.
      Sets the row group information to be used with this reader
      Parameters:
      pages - row group information for all the columns
      metadata - map of ColumnPath -> ColumnChunkMetaData for the row group
      rowPosition - the row group's row offset in the parquet file

    • setRowGroupInfo

      default void setRowGroupInfo(org.apache.parquet.column.page.PageReadStore pages, Map<org.apache.parquet.hadoop.metadata.ColumnPath,org.apache.parquet.hadoop.metadata.ColumnChunkMetaData> metadata)
      Sets the row group information to be used with this reader
      Parameters:
      pages - row group information for all the columns
      metadata - map of ColumnPath -> ColumnChunkMetaData for the row group

    • close

      void close()
      Release any resources allocated.