Class SparkPositionDeletesRewrite

java.lang.Object
org.apache.iceberg.spark.source.SparkPositionDeletesRewrite
All Implemented Interfaces:
org.apache.spark.sql.connector.write.Write

public class SparkPositionDeletesRewrite extends Object implements org.apache.spark.sql.connector.write.Write
Write class for rewriting position delete files from Spark. Responsible for creating SparkPositionDeletesRewrite.PositionDeleteBatchWrite

This class is meant to be used for an action to rewrite position delete files. Hence, it assumes all position deletes to rewrite have come from ScanTaskSetManager and that all have the same partition spec id and partition values.

  • Method Details

    • toBatch

      public org.apache.spark.sql.connector.write.BatchWrite toBatch()
      Specified by:
      toBatch in interface org.apache.spark.sql.connector.write.Write