Package org.apache.iceberg

Interface DeletedDataFileScanTask

  • All Superinterfaces:
    ChangelogScanTask, ContentScanTask<DataFile>, ScanTask, java.io.Serializable
    public interface DeletedDataFileScanTask
extends ChangelogScanTask, ContentScanTask<DataFile>
    A scan task for deletes generated by removing a data file from the table.

    Note that all historical delete files added earlier must be applied while reading the data file. This is required to output only those data records that were live when the data file was removed.

    Suppose snapshot S1 contains data files F1, F2, F3. Then snapshot S2 adds a position delete file, D1, that deletes records from F2 and snapshot S3 removes F2 entirely. A scan for changes generated by S3 should include the following task:

    • DeletedDataFileScanTask(file=F2, existing-deletes=[D1], snapshot=S3)

    Readers consuming these tasks should produce deleted records with metadata like change ordinal and commit snapshot ID.

    • Method Detail

      • existingDeletes

        java.util.List<DeleteFile> existingDeletes()
        A list of previously added delete files to apply when reading the data file in this task.
        Returns:
        a list of delete files to apply