Class ParquetWriteAdapter<D>

  • All Implemented Interfaces:
    java.io.Closeable, java.lang.AutoCloseable, FileAppender<D>

    public class ParquetWriteAdapter<D>
    extends java.lang.Object
    implements FileAppender<D>
    • Constructor Detail

      • ParquetWriteAdapter

        public ParquetWriteAdapter​(org.apache.parquet.hadoop.ParquetWriter<D> writer,
                                   MetricsConfig metricsConfig)
    • Method Detail

      • add

        public void add​(D datum)
        Specified by:
        add in interface FileAppender<D>
      • length

        public long length()
        Specified by:
        length in interface FileAppender<D>
        Returns:
        the length of this file.
      • splitOffsets

        public java.util.List<java.lang.Long> splitOffsets()
        Specified by:
        splitOffsets in interface FileAppender<D>
        Returns:
        a list of recommended split locations, if applicable, null otherwise. When available, this information is used for planning scan tasks whose boundaries are determined by these offsets. The returned list must be sorted in ascending order. Only valid after the file is closed.
      • close

        public void close()
                   throws java.io.IOException
        Specified by:
        close in interface java.lang.AutoCloseable
        Specified by:
        close in interface java.io.Closeable
        Throws:
        java.io.IOException