Package org.apache.iceberg.spark.actions
Class ManifestFileBean
- java.lang.Object
-
- org.apache.iceberg.spark.actions.ManifestFileBean
-
- All Implemented Interfaces:
ManifestFile
public class ManifestFileBean extends java.lang.Object implements ManifestFile
-
-
Nested Class Summary
-
Nested classes/interfaces inherited from interface org.apache.iceberg.ManifestFile
ManifestFile.PartitionFieldSummary
-
-
Field Summary
Fields Modifier and Type Field Description static org.apache.spark.sql.Encoder<ManifestFileBean>
ENCODER
-
Fields inherited from interface org.apache.iceberg.ManifestFile
ADDED_FILES_COUNT, ADDED_ROWS_COUNT, DELETED_FILES_COUNT, DELETED_ROWS_COUNT, EXISTING_FILES_COUNT, EXISTING_ROWS_COUNT, KEY_METADATA, LENGTH, MANIFEST_CONTENT, MIN_SEQUENCE_NUMBER, PARTITION_SUMMARIES, PARTITION_SUMMARY_TYPE, PATH, SCHEMA, SEQUENCE_NUMBER, SNAPSHOT_ID, SPEC_ID
-
-
Constructor Summary
Constructors Constructor Description ManifestFileBean()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description java.lang.Integer
addedFilesCount()
Returns the number of data files with status ADDED in the manifest file.java.lang.Long
addedRowsCount()
Returns the total number of rows in all data files with status ADDED in the manifest file.ManifestContent
content()
Returns the content stored in the manifest; either DATA or DELETES.ManifestFile
copy()
Copies thismanifest file
.java.lang.Integer
deletedFilesCount()
Returns the number of data files with status DELETED in the manifest file.java.lang.Long
deletedRowsCount()
Returns the total number of rows in all data files with status DELETED in the manifest file.java.lang.Integer
existingFilesCount()
Returns the number of data files with status EXISTING in the manifest file.java.lang.Long
existingRowsCount()
Returns the total number of rows in all data files with status EXISTING in the manifest file.java.lang.Long
getAddedSnapshotId()
java.lang.Integer
getContent()
java.lang.Long
getLength()
java.lang.Integer
getPartitionSpecId()
java.lang.String
getPath()
java.nio.ByteBuffer
keyMetadata()
Returns metadata about how this manifest file is encrypted, or null if the file is stored in plain text.long
length()
Returns length of the manifest file.long
minSequenceNumber()
Returns the lowest data sequence number of any live file in the manifest.java.util.List<ManifestFile.PartitionFieldSummary>
partitions()
Returns a list ofpartition field summaries
.int
partitionSpecId()
Returns iD of thePartitionSpec
used to write the manifest file.java.lang.String
path()
Returns fully qualified path to the file, suitable for constructing a Hadoop Path.long
sequenceNumber()
Returns the sequence number of the commit that added the manifest file.void
setAddedSnapshotId(java.lang.Long addedSnapshotId)
void
setContent(java.lang.Integer content)
void
setLength(java.lang.Long length)
void
setPartitionSpecId(java.lang.Integer partitionSpecId)
void
setPath(java.lang.String path)
java.lang.Long
snapshotId()
Returns iD of the snapshot that added the manifest file to table metadata.-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
Methods inherited from interface org.apache.iceberg.ManifestFile
hasAddedFiles, hasDeletedFiles, hasExistingFiles
-
-
-
-
Field Detail
-
ENCODER
public static final org.apache.spark.sql.Encoder<ManifestFileBean> ENCODER
-
-
Method Detail
-
getPath
public java.lang.String getPath()
-
setPath
public void setPath(java.lang.String path)
-
getLength
public java.lang.Long getLength()
-
setLength
public void setLength(java.lang.Long length)
-
getPartitionSpecId
public java.lang.Integer getPartitionSpecId()
-
setPartitionSpecId
public void setPartitionSpecId(java.lang.Integer partitionSpecId)
-
getAddedSnapshotId
public java.lang.Long getAddedSnapshotId()
-
setAddedSnapshotId
public void setAddedSnapshotId(java.lang.Long addedSnapshotId)
-
getContent
public java.lang.Integer getContent()
-
setContent
public void setContent(java.lang.Integer content)
-
path
public java.lang.String path()
Description copied from interface:ManifestFile
Returns fully qualified path to the file, suitable for constructing a Hadoop Path.- Specified by:
path
in interfaceManifestFile
-
length
public long length()
Description copied from interface:ManifestFile
Returns length of the manifest file.- Specified by:
length
in interfaceManifestFile
-
partitionSpecId
public int partitionSpecId()
Description copied from interface:ManifestFile
Returns iD of thePartitionSpec
used to write the manifest file.- Specified by:
partitionSpecId
in interfaceManifestFile
-
content
public ManifestContent content()
Description copied from interface:ManifestFile
Returns the content stored in the manifest; either DATA or DELETES.- Specified by:
content
in interfaceManifestFile
-
sequenceNumber
public long sequenceNumber()
Description copied from interface:ManifestFile
Returns the sequence number of the commit that added the manifest file.- Specified by:
sequenceNumber
in interfaceManifestFile
-
minSequenceNumber
public long minSequenceNumber()
Description copied from interface:ManifestFile
Returns the lowest data sequence number of any live file in the manifest.- Specified by:
minSequenceNumber
in interfaceManifestFile
-
snapshotId
public java.lang.Long snapshotId()
Description copied from interface:ManifestFile
Returns iD of the snapshot that added the manifest file to table metadata.- Specified by:
snapshotId
in interfaceManifestFile
-
addedFilesCount
public java.lang.Integer addedFilesCount()
Description copied from interface:ManifestFile
Returns the number of data files with status ADDED in the manifest file.- Specified by:
addedFilesCount
in interfaceManifestFile
-
addedRowsCount
public java.lang.Long addedRowsCount()
Description copied from interface:ManifestFile
Returns the total number of rows in all data files with status ADDED in the manifest file.- Specified by:
addedRowsCount
in interfaceManifestFile
-
existingFilesCount
public java.lang.Integer existingFilesCount()
Description copied from interface:ManifestFile
Returns the number of data files with status EXISTING in the manifest file.- Specified by:
existingFilesCount
in interfaceManifestFile
-
existingRowsCount
public java.lang.Long existingRowsCount()
Description copied from interface:ManifestFile
Returns the total number of rows in all data files with status EXISTING in the manifest file.- Specified by:
existingRowsCount
in interfaceManifestFile
-
deletedFilesCount
public java.lang.Integer deletedFilesCount()
Description copied from interface:ManifestFile
Returns the number of data files with status DELETED in the manifest file.- Specified by:
deletedFilesCount
in interfaceManifestFile
-
deletedRowsCount
public java.lang.Long deletedRowsCount()
Description copied from interface:ManifestFile
Returns the total number of rows in all data files with status DELETED in the manifest file.- Specified by:
deletedRowsCount
in interfaceManifestFile
-
partitions
public java.util.List<ManifestFile.PartitionFieldSummary> partitions()
Description copied from interface:ManifestFile
Returns a list ofpartition field summaries
.Each summary corresponds to a field in the manifest file's partition spec, by ordinal. For example, the partition spec [ ts_day=date(ts), type=identity(type) ] will have 2 summaries. The first summary is for the ts_day partition field and the second is for the type partition field.
- Specified by:
partitions
in interfaceManifestFile
- Returns:
- a list of partition field summaries, one for each field in the manifest's spec
-
keyMetadata
public java.nio.ByteBuffer keyMetadata()
Description copied from interface:ManifestFile
Returns metadata about how this manifest file is encrypted, or null if the file is stored in plain text.- Specified by:
keyMetadata
in interfaceManifestFile
-
copy
public ManifestFile copy()
Description copied from interface:ManifestFile
Copies thismanifest file
. Readers can reuse manifest file instances; use this method to make defensive copies.- Specified by:
copy
in interfaceManifestFile
- Returns:
- a copy of this manifest file
-
-