org.apache.iceberg.spark.actions

Class ManifestFileBean

java.lang.Object

org.apache.iceberg.spark.actions.ManifestFileBean

All Implemented Interfaces:

java.io.Serializable, ManifestFile

public class ManifestFileBean
extends java.lang.Object
implements ManifestFile, java.io.Serializable

A serializable bean that contains a bare minimum to read a manifest.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.iceberg.ManifestFile

ManifestFile.PartitionFieldSummary

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.spark.sql.Encoder<ManifestFileBean>	ENCODER

Fields inherited from interface org.apache.iceberg.ManifestFile

ADDED_FILES_COUNT, ADDED_ROWS_COUNT, DELETED_FILES_COUNT, DELETED_ROWS_COUNT, EXISTING_FILES_COUNT, EXISTING_ROWS_COUNT, KEY_METADATA, LENGTH, MANIFEST_CONTENT, MIN_SEQUENCE_NUMBER, PARTITION_SUMMARIES, PARTITION_SUMMARY_TYPE, PATH, SCHEMA, SEQUENCE_NUMBER, SNAPSHOT_ID, SPEC_ID

Constructor Summary

Constructors

Constructor and Description
ManifestFileBean()

Method Summary

Modifier and Type	Method and Description
java.lang.Integer	addedFilesCount() Returns the number of files with status ADDED in the manifest file.
java.lang.Long	addedRowsCount() Returns the total number of rows in all files with status ADDED in the manifest file.
ManifestContent	content() Returns the content stored in the manifest; either DATA or DELETES.
ManifestFile	copy() Copies this manifest file.
java.lang.Integer	deletedFilesCount() Returns the number of files with status DELETED in the manifest file.
java.lang.Long	deletedRowsCount() Returns the total number of rows in all files with status DELETED in the manifest file.
java.lang.Integer	existingFilesCount() Returns the number of files with status EXISTING in the manifest file.
java.lang.Long	existingRowsCount() Returns the total number of rows in all files with status EXISTING in the manifest file.
static ManifestFileBean	fromManifest(ManifestFile manifest)
java.lang.Long	getAddedSnapshotId()
java.lang.Integer	getContent()
java.lang.Long	getLength()
java.lang.Integer	getPartitionSpecId()
java.lang.String	getPath()
java.lang.Long	getSequenceNumber()
java.nio.ByteBuffer	keyMetadata() Returns metadata about how this manifest file is encrypted, or null if the file is stored in plain text.
long	length() Returns length of the manifest file.
long	minSequenceNumber() Returns the lowest data sequence number of any live file in the manifest.
java.util.List<ManifestFile.PartitionFieldSummary>	partitions() Returns a list of partition field summaries.
int	partitionSpecId() Returns iD of the PartitionSpec used to write the manifest file.
java.lang.String	path() Returns fully qualified path to the file, suitable for constructing a Hadoop Path.
long	sequenceNumber() Returns the sequence number of the commit that added the manifest file.
void	setAddedSnapshotId(java.lang.Long addedSnapshotId)
void	setContent(java.lang.Integer content)
void	setLength(java.lang.Long length)
void	setPartitionSpecId(java.lang.Integer partitionSpecId)
void	setPath(java.lang.String path)
void	setSequenceNumber(java.lang.Long sequenceNumber)
java.lang.Long	snapshotId() Returns iD of the snapshot that added the manifest file to table metadata.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.iceberg.ManifestFile

hasAddedFiles, hasDeletedFiles, hasExistingFiles, schema

Field Detail

ENCODER

public static final org.apache.spark.sql.Encoder<ManifestFileBean> ENCODER

Constructor Detail

ManifestFileBean

public ManifestFileBean()

Method Detail

fromManifest

public static ManifestFileBean fromManifest(ManifestFile manifest)

getPath

public java.lang.String getPath()

setPath

public void setPath(java.lang.String path)

getLength

public java.lang.Long getLength()

setLength

public void setLength(java.lang.Long length)

getPartitionSpecId

public java.lang.Integer getPartitionSpecId()

setPartitionSpecId

public void setPartitionSpecId(java.lang.Integer partitionSpecId)

getAddedSnapshotId

public java.lang.Long getAddedSnapshotId()

setAddedSnapshotId

public void setAddedSnapshotId(java.lang.Long addedSnapshotId)

getContent

public java.lang.Integer getContent()

setContent

public void setContent(java.lang.Integer content)

getSequenceNumber

public java.lang.Long getSequenceNumber()

setSequenceNumber

public void setSequenceNumber(java.lang.Long sequenceNumber)

path

public java.lang.String path()

Description copied from interface: ManifestFile

Returns fully qualified path to the file, suitable for constructing a Hadoop Path.

Specified by:

path in interface ManifestFile

length

public long length()

Description copied from interface: ManifestFile

Returns length of the manifest file.

Specified by:

length in interface ManifestFile

partitionSpecId

public int partitionSpecId()

Description copied from interface: ManifestFile

Returns iD of the PartitionSpec used to write the manifest file.

Specified by:

partitionSpecId in interface ManifestFile

content

public ManifestContent content()

Description copied from interface: ManifestFile

Returns the content stored in the manifest; either DATA or DELETES.

Specified by:

content in interface ManifestFile

sequenceNumber

public long sequenceNumber()

Description copied from interface: ManifestFile

Returns the sequence number of the commit that added the manifest file.

Specified by:

sequenceNumber in interface ManifestFile

minSequenceNumber

public long minSequenceNumber()

Description copied from interface: ManifestFile

Returns the lowest data sequence number of any live file in the manifest.

Specified by:

minSequenceNumber in interface ManifestFile

snapshotId

public java.lang.Long snapshotId()

Description copied from interface: ManifestFile

Returns iD of the snapshot that added the manifest file to table metadata.

Specified by:

snapshotId in interface ManifestFile

addedFilesCount

public java.lang.Integer addedFilesCount()

Description copied from interface: ManifestFile

Returns the number of files with status ADDED in the manifest file.

Specified by:

addedFilesCount in interface ManifestFile

addedRowsCount

public java.lang.Long addedRowsCount()

Description copied from interface: ManifestFile

Returns the total number of rows in all files with status ADDED in the manifest file.

Specified by:

addedRowsCount in interface ManifestFile

existingFilesCount

public java.lang.Integer existingFilesCount()

Description copied from interface: ManifestFile

Returns the number of files with status EXISTING in the manifest file.

Specified by:

existingFilesCount in interface ManifestFile

existingRowsCount

public java.lang.Long existingRowsCount()

Description copied from interface: ManifestFile

Returns the total number of rows in all files with status EXISTING in the manifest file.

Specified by:

existingRowsCount in interface ManifestFile

deletedFilesCount

public java.lang.Integer deletedFilesCount()

Description copied from interface: ManifestFile

Returns the number of files with status DELETED in the manifest file.

Specified by:

deletedFilesCount in interface ManifestFile

deletedRowsCount

public java.lang.Long deletedRowsCount()

Description copied from interface: ManifestFile

Returns the total number of rows in all files with status DELETED in the manifest file.

Specified by:

deletedRowsCount in interface ManifestFile

partitions

public java.util.List<ManifestFile.PartitionFieldSummary> partitions()

Description copied from interface: ManifestFile

Returns a list of partition field summaries.

Each summary corresponds to a field in the manifest file's partition spec, by ordinal. For example, the partition spec [ ts_day=date(ts), type=identity(type) ] will have 2 summaries. The first summary is for the ts_day partition field and the second is for the type partition field.

Specified by:

partitions in interface ManifestFile

Returns:

a list of partition field summaries, one for each field in the manifest's spec

keyMetadata

public java.nio.ByteBuffer keyMetadata()

Description copied from interface: ManifestFile

Returns metadata about how this manifest file is encrypted, or null if the file is stored in plain text.

Specified by:

keyMetadata in interface ManifestFile

copy

public ManifestFile copy()

Description copied from interface: ManifestFile

Copies this manifest file. Readers can reuse manifest file instances; use this method to make defensive copies.

Specified by:

copy in interface ManifestFile

Returns:

a copy of this manifest file