Package org.apache.iceberg.parquet

Class ParquetFormatModel<D,S,R>

java.lang.Object

org.apache.iceberg.formats.BaseFormatModel<D,S,ParquetValueWriter<?>,R,org.apache.parquet.schema.MessageType>

org.apache.iceberg.parquet.ParquetFormatModel<D,S,R>

All Implemented Interfaces:

FormatModel<D,S>

public class ParquetFormatModel<D,S,R>
extends BaseFormatModel<D,S,ParquetValueWriter<?>,R,org.apache.parquet.schema.MessageType>

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.iceberg.formats.BaseFormatModel

BaseFormatModel.ReaderFunction<R,S,F>, BaseFormatModel.WriterFunction<W,S,F>

Method Summary

Modifier and Type	Method	Description
static <D, S> ParquetFormatModel<D,S,VectorizedReader<?>>	create(Class<? extends D> type, Class<S> schemaType, BaseFormatModel.ReaderFunction<VectorizedReader<?>,S,org.apache.parquet.schema.MessageType> batchReaderFunction)
static <D, S> ParquetFormatModel<D,S,ParquetValueReader<?>>	create(Class<D> type, Class<S> schemaType, BaseFormatModel.WriterFunction<ParquetValueWriter<?>,S,org.apache.parquet.schema.MessageType> writerFunction, BaseFormatModel.ReaderFunction<ParquetValueReader<?>,S,org.apache.parquet.schema.MessageType> readerFunction)
static <D, S> ParquetFormatModel<D,S,ParquetValueReader<?>>	create(Class<D> type, Class<S> schemaType, BaseFormatModel.WriterFunction<ParquetValueWriter<?>,S,org.apache.parquet.schema.MessageType> writerFunction, BaseFormatModel.ReaderFunction<ParquetValueReader<?>,S,org.apache.parquet.schema.MessageType> readerFunction, VariantShreddingAnalyzer<D,S> variantAnalyzer, UnaryOperator<D> copyFunc)
FileFormat	format()	The file format which is read/written by the object model.
static <D> ParquetFormatModel<PositionDelete<D>,Void,Object>	forPositionDeletes()
ReadBuilder<D,S>	readBuilder(InputFile inputFile)	Creates a file reader builder for the specified input file.
ModelWriteBuilder<D,S>	writeBuilder(EncryptedOutputFile outputFile)	Creates a writer builder for data files.

Methods inherited from class org.apache.iceberg.formats.BaseFormatModel

readerFunction, schemaType, type, writerFunction

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

forPositionDeletes

public static <D>
ParquetFormatModel<PositionDelete<D>,Void,Object> forPositionDeletes()

create

public static <D,
S>
ParquetFormatModel<D,S,ParquetValueReader<?>> create(Class<D> type,
 Class<S> schemaType,
 BaseFormatModel.WriterFunction<ParquetValueWriter<?>,S,org.apache.parquet.schema.MessageType> writerFunction,
 BaseFormatModel.ReaderFunction<ParquetValueReader<?>,S,org.apache.parquet.schema.MessageType> readerFunction)

create

public static <D,
S>
ParquetFormatModel<D,S,ParquetValueReader<?>> create(Class<D> type,
 Class<S> schemaType,
 BaseFormatModel.WriterFunction<ParquetValueWriter<?>,S,org.apache.parquet.schema.MessageType> writerFunction,
 BaseFormatModel.ReaderFunction<ParquetValueReader<?>,S,org.apache.parquet.schema.MessageType> readerFunction,
 VariantShreddingAnalyzer<D,S> variantAnalyzer,
 UnaryOperator<D> copyFunc)

create

public static <D,
S>
ParquetFormatModel<D,S,VectorizedReader<?>> create(Class<? extends D> type,
 Class<S> schemaType,
 BaseFormatModel.ReaderFunction<VectorizedReader<?>,S,org.apache.parquet.schema.MessageType> batchReaderFunction)

format

public FileFormat format()

Description copied from interface: FormatModel

The file format which is read/written by the object model.

writeBuilder

public ModelWriteBuilder<D,S> writeBuilder(EncryptedOutputFile outputFile)

Description copied from interface: FormatModel

Creates a writer builder for data files.

The returned ModelWriteBuilder configures and creates a writer that converts input objects into the file format supported by this factory.

Parameters:

outputFile - destination for the written data

Returns:

configured writer builder

readBuilder

public ReadBuilder<D,S> readBuilder(InputFile inputFile)

Description copied from interface: FormatModel

Creates a file reader builder for the specified input file.

The returned ReadBuilder configures and creates a reader that converts data from the file format into output objects supported by this factory.

Parameters:

inputFile - source file to read from

Returns:

configured reader builder for the specified input