org.apache.iceberg.parquet

Class ParquetCodecFactory

java.lang.Object

org.apache.parquet.hadoop.CodecFactory

org.apache.iceberg.parquet.ParquetCodecFactory

All Implemented Interfaces:

org.apache.parquet.compression.CompressionCodecFactory

public class ParquetCodecFactory
extends org.apache.parquet.hadoop.CodecFactory

This class implements a codec factory that is used when reading from Parquet. It adds a workaround for memory issues encountered when reading from zstd-compressed files.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.parquet.hadoop.CodecFactory

org.apache.parquet.hadoop.CodecFactory.BytesCompressor, org.apache.parquet.hadoop.CodecFactory.BytesDecompressor

Nested classes/interfaces inherited from interface org.apache.parquet.compression.CompressionCodecFactory

org.apache.parquet.compression.CompressionCodecFactory.BytesInputCompressor, org.apache.parquet.compression.CompressionCodecFactory.BytesInputDecompressor

Field Summary

Fields inherited from class org.apache.parquet.hadoop.CodecFactory

CODEC_BY_NAME, configuration, pageSize

Constructor Summary

Constructors

Constructor and Description
ParquetCodecFactory(org.apache.hadoop.conf.Configuration configuration, int pageSize)

Method Summary

Modifier and Type	Method and Description
protected org.apache.parquet.hadoop.CodecFactory.BytesDecompressor	createDecompressor(org.apache.parquet.hadoop.metadata.CompressionCodecName codecName)

Methods inherited from class org.apache.parquet.hadoop.CodecFactory

createCompressor, createDirectCodecFactory, getCodec, getCompressor, getDecompressor, release

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetCodecFactory

public ParquetCodecFactory(org.apache.hadoop.conf.Configuration configuration,
                           int pageSize)

Method Detail

createDecompressor

protected org.apache.parquet.hadoop.CodecFactory.BytesDecompressor createDecompressor(org.apache.parquet.hadoop.metadata.CompressionCodecName codecName)

Overrides:

createDecompressor in class org.apache.parquet.hadoop.CodecFactory