Package org.apache.iceberg.spark.actions

Class ManifestFileBean

  • All Implemented Interfaces:
    java.io.Serializable, ManifestFile
    public class ManifestFileBean
extends java.lang.Object
implements ManifestFile, java.io.Serializable
    A serializable bean that contains a bare minimum to read a manifest.
    See Also:
    Serialized Form

    • Field Detail

      • ENCODER

        public static final org.apache.spark.sql.Encoder<ManifestFileBean> ENCODER

    • Constructor Detail

      • ManifestFileBean

        public ManifestFileBean()

    • Method Detail

      • getPath

        public java.lang.String getPath()

      • setPath

        public void setPath​(java.lang.String path)

      • getLength

        public java.lang.Long getLength()

      • setLength

        public void setLength​(java.lang.Long length)

      • getPartitionSpecId

        public java.lang.Integer getPartitionSpecId()

      • setPartitionSpecId

        public void setPartitionSpecId​(java.lang.Integer partitionSpecId)

      • getAddedSnapshotId

        public java.lang.Long getAddedSnapshotId()

      • setAddedSnapshotId

        public void setAddedSnapshotId​(java.lang.Long addedSnapshotId)

      • getContent

        public java.lang.Integer getContent()

      • setContent

        public void setContent​(java.lang.Integer content)

      • getSequenceNumber

        public java.lang.Long getSequenceNumber()

      • setSequenceNumber

        public void setSequenceNumber​(java.lang.Long sequenceNumber)

      • path

        public java.lang.String path()
        Description copied from interface: ManifestFile
        Returns fully qualified path to the file, suitable for constructing a Hadoop Path.
        Specified by:
        path in interface ManifestFile

      • length

        public long length()
        Description copied from interface: ManifestFile
        Returns length of the manifest file.
        Specified by:
        length in interface ManifestFile

      • sequenceNumber

        public long sequenceNumber()
        Description copied from interface: ManifestFile
        Returns the sequence number of the commit that added the manifest file.
        Specified by:
        sequenceNumber in interface ManifestFile

      • minSequenceNumber

        public long minSequenceNumber()
        Description copied from interface: ManifestFile
        Returns the lowest data sequence number of any live file in the manifest.
        Specified by:
        minSequenceNumber in interface ManifestFile

      • snapshotId

        public java.lang.Long snapshotId()
        Description copied from interface: ManifestFile
        Returns iD of the snapshot that added the manifest file to table metadata.
        Specified by:
        snapshotId in interface ManifestFile

      • addedFilesCount

        public java.lang.Integer addedFilesCount()
        Description copied from interface: ManifestFile
        Returns the number of data files with status ADDED in the manifest file.
        Specified by:
        addedFilesCount in interface ManifestFile

      • addedRowsCount

        public java.lang.Long addedRowsCount()
        Description copied from interface: ManifestFile
        Returns the total number of rows in all data files with status ADDED in the manifest file.
        Specified by:
        addedRowsCount in interface ManifestFile

      • existingFilesCount

        public java.lang.Integer existingFilesCount()
        Description copied from interface: ManifestFile
        Returns the number of data files with status EXISTING in the manifest file.
        Specified by:
        existingFilesCount in interface ManifestFile

      • existingRowsCount

        public java.lang.Long existingRowsCount()
        Description copied from interface: ManifestFile
        Returns the total number of rows in all data files with status EXISTING in the manifest file.
        Specified by:
        existingRowsCount in interface ManifestFile

      • deletedFilesCount

        public java.lang.Integer deletedFilesCount()
        Description copied from interface: ManifestFile
        Returns the number of data files with status DELETED in the manifest file.
        Specified by:
        deletedFilesCount in interface ManifestFile

      • deletedRowsCount

        public java.lang.Long deletedRowsCount()
        Description copied from interface: ManifestFile
        Returns the total number of rows in all data files with status DELETED in the manifest file.
        Specified by:
        deletedRowsCount in interface ManifestFile

      • partitions

        public java.util.List<ManifestFile.PartitionFieldSummary> partitions()
        Description copied from interface: ManifestFile
        Returns a list of partition field summaries.

        Each summary corresponds to a field in the manifest file's partition spec, by ordinal. For example, the partition spec [ ts_day=date(ts), type=identity(type) ] will have 2 summaries. The first summary is for the ts_day partition field and the second is for the type partition field.

        Specified by:
        partitions in interface ManifestFile
        Returns:
        a list of partition field summaries, one for each field in the manifest's spec

      • keyMetadata

        public java.nio.ByteBuffer keyMetadata()
        Description copied from interface: ManifestFile
        Returns metadata about how this manifest file is encrypted, or null if the file is stored in plain text.
        Specified by:
        keyMetadata in interface ManifestFile

      • copy

        public ManifestFile copy()
        Description copied from interface: ManifestFile
        Copies this manifest file. Readers can reuse manifest file instances; use this method to make defensive copies.
        Specified by:
        copy in interface ManifestFile
        Returns:
        a copy of this manifest file