Package org.apache.iceberg.spark
Class PositionDeletesRewriteCoordinator
- java.lang.Object
-
- org.apache.iceberg.spark.PositionDeletesRewriteCoordinator
-
public class PositionDeletesRewriteCoordinator extends java.lang.Object
-
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description void
clearRewrite(Table table, java.lang.String fileSetId)
java.util.Set<F>
fetchNewFiles(Table table, java.lang.String fileSetId)
java.util.Set<java.lang.String>
fetchSetIds(Table table)
static PositionDeletesRewriteCoordinator
get()
void
stageRewrite(Table table, java.lang.String fileSetId, java.util.Set<F> newFiles)
Called to persist the output of a rewrite action for a specific group.
-
-
-
Method Detail
-
get
public static PositionDeletesRewriteCoordinator get()
-
stageRewrite
public void stageRewrite(Table table, java.lang.String fileSetId, java.util.Set<F> newFiles)
Called to persist the output of a rewrite action for a specific group. Since the write is done via a Spark Datasource, we have to propagate the result through this side-effect call.- Parameters:
table
- table where the rewrite is occurringfileSetId
- the id used to identify the source set of files being rewrittennewFiles
- the new files which have been written
-
fetchNewFiles
public java.util.Set<F> fetchNewFiles(Table table, java.lang.String fileSetId)
-
clearRewrite
public void clearRewrite(Table table, java.lang.String fileSetId)
-
fetchSetIds
public java.util.Set<java.lang.String> fetchSetIds(Table table)
-
-