Class ParquetUtil


  • public class ParquetUtil
    extends java.lang.Object
    • Method Summary

      All Methods Static Methods Concrete Methods 
      Modifier and Type Method Description
      static Metrics fileMetrics​(InputFile file, MetricsConfig metricsConfig)  
      static Metrics footerMetrics​(org.apache.parquet.hadoop.metadata.ParquetMetadata metadata, MetricsConfig metricsConfig)  
      static java.util.List<java.lang.Long> getSplitOffsets​(org.apache.parquet.hadoop.metadata.ParquetMetadata md)  
      static boolean hasNonDictionaryPages​(org.apache.parquet.hadoop.metadata.ColumnChunkMetaData meta)  
      static boolean isIntType​(org.apache.parquet.schema.PrimitiveType primitiveType)  
      static org.apache.parquet.column.Dictionary readDictionary​(org.apache.parquet.column.ColumnDescriptor desc, org.apache.parquet.column.page.PageReader pageSource)  
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Method Detail

      • footerMetrics

        public static Metrics footerMetrics​(org.apache.parquet.hadoop.metadata.ParquetMetadata metadata,
                                            MetricsConfig metricsConfig)
      • getSplitOffsets

        public static java.util.List<java.lang.Long> getSplitOffsets​(org.apache.parquet.hadoop.metadata.ParquetMetadata md)
        Returns:
        a list of offsets in ascending order determined by the starting position of the row groups
      • hasNonDictionaryPages

        public static boolean hasNonDictionaryPages​(org.apache.parquet.hadoop.metadata.ColumnChunkMetaData meta)
      • readDictionary

        public static org.apache.parquet.column.Dictionary readDictionary​(org.apache.parquet.column.ColumnDescriptor desc,
                                                                          org.apache.parquet.column.page.PageReader pageSource)
      • isIntType

        public static boolean isIntType​(org.apache.parquet.schema.PrimitiveType primitiveType)