Class ParquetCodecFactory

  • All Implemented Interfaces:
    org.apache.parquet.compression.CompressionCodecFactory

    public class ParquetCodecFactory
    extends org.apache.parquet.hadoop.CodecFactory
    This class implements a codec factory that is used when reading from Parquet. It adds a workaround for memory issues encountered when reading from zstd-compressed files.
    • Nested Class Summary

      • Nested classes/interfaces inherited from class org.apache.parquet.hadoop.CodecFactory

        org.apache.parquet.hadoop.CodecFactory.BytesCompressor, org.apache.parquet.hadoop.CodecFactory.BytesDecompressor
      • Nested classes/interfaces inherited from interface org.apache.parquet.compression.CompressionCodecFactory

        org.apache.parquet.compression.CompressionCodecFactory.BytesInputCompressor, org.apache.parquet.compression.CompressionCodecFactory.BytesInputDecompressor
    • Field Summary

      • Fields inherited from class org.apache.parquet.hadoop.CodecFactory

        CODEC_BY_NAME, configuration, pageSize
    • Constructor Summary

      Constructors 
      Constructor Description
      ParquetCodecFactory​(org.apache.hadoop.conf.Configuration configuration, int pageSize)  
    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      protected org.apache.parquet.hadoop.CodecFactory.BytesDecompressor createDecompressor​(org.apache.parquet.hadoop.metadata.CompressionCodecName codecName)  
      • Methods inherited from class org.apache.parquet.hadoop.CodecFactory

        createCompressor, createDirectCodecFactory, getCodec, getCompressor, getDecompressor, release
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Constructor Detail

      • ParquetCodecFactory

        public ParquetCodecFactory​(org.apache.hadoop.conf.Configuration configuration,
                                   int pageSize)
    • Method Detail

      • createDecompressor

        protected org.apache.parquet.hadoop.CodecFactory.BytesDecompressor createDecompressor​(org.apache.parquet.hadoop.metadata.CompressionCodecName codecName)
        Overrides:
        createDecompressor in class org.apache.parquet.hadoop.CodecFactory