Package org.apache.iceberg.actions
Class RewriteDataFilesCommitManager.CommitService
- java.lang.Object
-
- org.apache.iceberg.actions.RewriteDataFilesCommitManager.CommitService
-
- All Implemented Interfaces:
java.io.Closeable
,java.lang.AutoCloseable
- Enclosing class:
- RewriteDataFilesCommitManager
public class RewriteDataFilesCommitManager.CommitService extends java.lang.Object
-
-
Field Summary
Fields Modifier and Type Field Description static long
TIMEOUT_IN_MS_DEFAULT
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description protected void
abortFileGroup(RewriteFileGroup group)
Clean up a specified file set by removing any files created for that operation, should not throw any exceptionsvoid
close()
protected void
commitOrClean(java.util.Set<RewriteFileGroup> batch)
Perform a commit operation on the table for the set of file groups, should cleanup failed file groups.void
offer(T group)
Places a file group in the queue and commits a batch of file groups ifBaseCommitService.rewritesPerCommit
number of file groups are present in the queue.java.util.List<T>
results()
Returns all File groups which have been committedvoid
start()
Starts a single threaded executor service for handling file group commits.
-
-
-
Method Detail
-
commitOrClean
protected void commitOrClean(java.util.Set<RewriteFileGroup> batch)
Perform a commit operation on the table for the set of file groups, should cleanup failed file groups.- Parameters:
batch
- set of file groups
-
abortFileGroup
protected void abortFileGroup(RewriteFileGroup group)
Clean up a specified file set by removing any files created for that operation, should not throw any exceptions- Parameters:
group
- group of files which are not yet committed
-
start
public void start()
Starts a single threaded executor service for handling file group commits.
-
offer
public void offer(T group)
Places a file group in the queue and commits a batch of file groups ifBaseCommitService.rewritesPerCommit
number of file groups are present in the queue.- Parameters:
group
- file group to eventually be committed
-
results
public java.util.List<T> results()
Returns all File groups which have been committed
-
close
public void close()
- Specified by:
close
in interfacejava.lang.AutoCloseable
- Specified by:
close
in interfacejava.io.Closeable
-
-