org.apache.iceberg.parquet

Class Parquet

java.lang.Object

org.apache.iceberg.parquet.Parquet

public class Parquet
extends java.lang.Object

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	Parquet.DataWriteBuilder
static class	Parquet.DeleteWriteBuilder
static class	Parquet.ReadBuilder
static class	Parquet.WriteBuilder

Method Summary

Modifier and Type	Method and Description
static void	concat(java.lang.Iterable<java.io.File> inputFiles, java.io.File outputFile, int rowGroupSize, Schema schema, java.util.Map<java.lang.String,java.lang.String> metadata) Combines several files into one
static Parquet.ReadBuilder	read(InputFile file)
static Parquet.WriteBuilder	write(EncryptedOutputFile file)
static Parquet.WriteBuilder	write(OutputFile file)
static Parquet.DataWriteBuilder	writeData(EncryptedOutputFile file)
static Parquet.DataWriteBuilder	writeData(OutputFile file)
static Parquet.DeleteWriteBuilder	writeDeletes(EncryptedOutputFile file)
static Parquet.DeleteWriteBuilder	writeDeletes(OutputFile file)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

write

public static Parquet.WriteBuilder write(OutputFile file)

write

public static Parquet.WriteBuilder write(EncryptedOutputFile file)

writeData

public static Parquet.DataWriteBuilder writeData(OutputFile file)

writeData

public static Parquet.DataWriteBuilder writeData(EncryptedOutputFile file)

writeDeletes

public static Parquet.DeleteWriteBuilder writeDeletes(OutputFile file)

writeDeletes

public static Parquet.DeleteWriteBuilder writeDeletes(EncryptedOutputFile file)

read

public static Parquet.ReadBuilder read(InputFile file)

concat

public static void concat(java.lang.Iterable<java.io.File> inputFiles,
                          java.io.File outputFile,
                          int rowGroupSize,
                          Schema schema,
                          java.util.Map<java.lang.String,java.lang.String> metadata)
                   throws java.io.IOException

Combines several files into one

Parameters:

inputFiles - an Iterable of parquet files. The order of iteration determines the order in which content of files are read and written to the outputFile

outputFile - the output parquet file containing all the data from inputFiles

rowGroupSize - the row group size to use when writing the outputFile

schema - the schema of the data

metadata - extraMetadata to write at the footer of the outputFile

Throws:

java.io.IOException