Package org.apache.iceberg.spark.actions
Class SparkActions
- java.lang.Object
-
- org.apache.iceberg.spark.actions.SparkActions
-
- All Implemented Interfaces:
ActionsProvider
public class SparkActions extends java.lang.Object implements ActionsProvider
An implementation ofActionsProvider
for Spark.This class is the primary API for interacting with actions in Spark that users should use to instantiate particular actions.
-
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description DeleteOrphanFilesSparkAction
deleteOrphanFiles(Table table)
Instantiates an action to delete orphan files.DeleteReachableFilesSparkAction
deleteReachableFiles(java.lang.String metadataLocation)
Instantiates an action to delete all the files reachable from given metadata location.ExpireSnapshotsSparkAction
expireSnapshots(Table table)
Instantiates an action to expire snapshots.static SparkActions
get()
static SparkActions
get(org.apache.spark.sql.SparkSession spark)
MigrateTableSparkAction
migrateTable(java.lang.String tableIdent)
Instantiates an action to migrate an existing table to Iceberg.RewriteDataFilesSparkAction
rewriteDataFiles(Table table)
Instantiates an action to rewrite data files.RewriteManifestsSparkAction
rewriteManifests(Table table)
Instantiates an action to rewrite manifests.RewritePositionDeleteFilesSparkAction
rewritePositionDeletes(Table table)
Instantiates an action to rewrite position delete filesSnapshotTableSparkAction
snapshotTable(java.lang.String tableIdent)
Instantiates an action to snapshot an existing table as a new Iceberg table.
-
-
-
Method Detail
-
get
public static SparkActions get(org.apache.spark.sql.SparkSession spark)
-
get
public static SparkActions get()
-
snapshotTable
public SnapshotTableSparkAction snapshotTable(java.lang.String tableIdent)
Description copied from interface:ActionsProvider
Instantiates an action to snapshot an existing table as a new Iceberg table.- Specified by:
snapshotTable
in interfaceActionsProvider
-
migrateTable
public MigrateTableSparkAction migrateTable(java.lang.String tableIdent)
Description copied from interface:ActionsProvider
Instantiates an action to migrate an existing table to Iceberg.- Specified by:
migrateTable
in interfaceActionsProvider
-
rewriteDataFiles
public RewriteDataFilesSparkAction rewriteDataFiles(Table table)
Description copied from interface:ActionsProvider
Instantiates an action to rewrite data files.- Specified by:
rewriteDataFiles
in interfaceActionsProvider
-
deleteOrphanFiles
public DeleteOrphanFilesSparkAction deleteOrphanFiles(Table table)
Description copied from interface:ActionsProvider
Instantiates an action to delete orphan files.- Specified by:
deleteOrphanFiles
in interfaceActionsProvider
-
rewriteManifests
public RewriteManifestsSparkAction rewriteManifests(Table table)
Description copied from interface:ActionsProvider
Instantiates an action to rewrite manifests.- Specified by:
rewriteManifests
in interfaceActionsProvider
-
expireSnapshots
public ExpireSnapshotsSparkAction expireSnapshots(Table table)
Description copied from interface:ActionsProvider
Instantiates an action to expire snapshots.- Specified by:
expireSnapshots
in interfaceActionsProvider
-
deleteReachableFiles
public DeleteReachableFilesSparkAction deleteReachableFiles(java.lang.String metadataLocation)
Description copied from interface:ActionsProvider
Instantiates an action to delete all the files reachable from given metadata location.- Specified by:
deleteReachableFiles
in interfaceActionsProvider
-
rewritePositionDeletes
public RewritePositionDeleteFilesSparkAction rewritePositionDeletes(Table table)
Description copied from interface:ActionsProvider
Instantiates an action to rewrite position delete files- Specified by:
rewritePositionDeletes
in interfaceActionsProvider
-
-