Package org.apache.iceberg.data

Class PartitionStatsHandler

java.lang.Object

org.apache.iceberg.data.PartitionStatsHandler

public class PartitionStatsHandler
extends Object

Computes, writes and reads the PartitionStatisticsFile. Uses generic readers and writers to support writing and reading of the stats in table default format.

Field Summary

Fields

Modifier and Type	Field	Description
static final Types.NestedField	DATA_FILE_COUNT
static final Types.NestedField	DATA_RECORD_COUNT
static final Types.NestedField	EQUALITY_DELETE_FILE_COUNT
static final Types.NestedField	EQUALITY_DELETE_RECORD_COUNT
static final Types.NestedField	LAST_UPDATED_AT
static final Types.NestedField	LAST_UPDATED_SNAPSHOT_ID
static final int	PARTITION_FIELD_ID
static final String	PARTITION_FIELD_NAME
static final Types.NestedField	POSITION_DELETE_FILE_COUNT
static final Types.NestedField	POSITION_DELETE_RECORD_COUNT
static final Types.NestedField	SPEC_ID
static final Types.NestedField	TOTAL_DATA_FILE_SIZE_IN_BYTES
static final Types.NestedField	TOTAL_RECORD_COUNT

Method Summary

Modifier and Type	Method	Description
static PartitionStatisticsFile	computeAndWriteStatsFile(Table table)	Computes and writes the PartitionStatisticsFile for a given table's current snapshot.
static PartitionStatisticsFile	computeAndWriteStatsFile(Table table, long snapshotId)	Computes and writes the PartitionStatisticsFile for a given table and snapshot.
static CloseableIterable<PartitionStats>	readPartitionStatsFile(Schema schema, InputFile inputFile)	Reads partition statistics from the specified InputFile using given schema.
static Schema	schema(Types.StructType unifiedPartitionType)	Generates the partition stats file schema based on a combined partition type which considers all specs in a table.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

PARTITION_FIELD_ID

public static final int PARTITION_FIELD_ID

See Also:

• Constant Field Values

PARTITION_FIELD_NAME

public static final String PARTITION_FIELD_NAME

See Also:

• Constant Field Values

SPEC_ID

public static final Types.NestedField SPEC_ID

DATA_RECORD_COUNT

public static final Types.NestedField DATA_RECORD_COUNT

DATA_FILE_COUNT

public static final Types.NestedField DATA_FILE_COUNT

TOTAL_DATA_FILE_SIZE_IN_BYTES

public static final Types.NestedField TOTAL_DATA_FILE_SIZE_IN_BYTES

POSITION_DELETE_RECORD_COUNT

public static final Types.NestedField POSITION_DELETE_RECORD_COUNT

POSITION_DELETE_FILE_COUNT

public static final Types.NestedField POSITION_DELETE_FILE_COUNT

EQUALITY_DELETE_RECORD_COUNT

public static final Types.NestedField EQUALITY_DELETE_RECORD_COUNT

EQUALITY_DELETE_FILE_COUNT

public static final Types.NestedField EQUALITY_DELETE_FILE_COUNT

TOTAL_RECORD_COUNT

public static final Types.NestedField TOTAL_RECORD_COUNT

LAST_UPDATED_AT

public static final Types.NestedField LAST_UPDATED_AT

LAST_UPDATED_SNAPSHOT_ID

public static final Types.NestedField LAST_UPDATED_SNAPSHOT_ID

Method Details

schema

public static Schema schema(Types.StructType unifiedPartitionType)

Generates the partition stats file schema based on a combined partition type which considers all specs in a table.

Parameters:

unifiedPartitionType - unified partition schema type. Could be calculated by Partitioning.partitionType(Table).

Returns:

a schema that corresponds to the provided unified partition type.

computeAndWriteStatsFile

public static PartitionStatisticsFile computeAndWriteStatsFile(Table table)
                                                        throws IOException

Computes and writes the PartitionStatisticsFile for a given table's current snapshot.

Parameters:

table - The Table for which the partition statistics is computed.

Returns:

PartitionStatisticsFile for the current snapshot, or null if no statistics are present.

Throws:

IOException

computeAndWriteStatsFile

public static PartitionStatisticsFile computeAndWriteStatsFile(Table table,
 long snapshotId)
                                                        throws IOException

Computes and writes the PartitionStatisticsFile for a given table and snapshot.

Parameters:

table - The Table for which the partition statistics is computed.

snapshotId - snapshot for which partition statistics are computed.

Returns:

PartitionStatisticsFile for the given snapshot, or null if no statistics are present.

Throws:

IOException

readPartitionStatsFile

public static CloseableIterable<PartitionStats> readPartitionStatsFile(Schema schema,
 InputFile inputFile)

Reads partition statistics from the specified InputFile using given schema.

Parameters:

schema - The Schema of the partition statistics file.

inputFile - An InputFile pointing to the partition stats file.