Class Parquet

  • public class Parquet
    extends java.lang.Object
    • Method Detail

      • concat

        public static void concat​(java.lang.Iterable<> inputFiles,
                                  int rowGroupSize,
                                  Schema schema,
                                  java.util.Map<java.lang.String,​java.lang.String> metadata)
        Combines several files into one
        inputFiles - an Iterable of parquet files. The order of iteration determines the order in which content of files are read and written to the outputFile
        outputFile - the output parquet file containing all the data from inputFiles
        rowGroupSize - the row group size to use when writing the outputFile
        schema - the schema of the data
        metadata - extraMetadata to write at the footer of the outputFile