Package org.apache.iceberg.actions

Class RewriteDataFilesCommitManager.CommitService

java.lang.Object
org.apache.iceberg.actions.RewriteDataFilesCommitManager.CommitService
All Implemented Interfaces:
Closeable, AutoCloseable
Enclosing class:
RewriteDataFilesCommitManager
public class RewriteDataFilesCommitManager.CommitService extends Object

  • Field Details

    • TIMEOUT_IN_MS_DEFAULT

      public static final long TIMEOUT_IN_MS_DEFAULT

  • Method Details

    • commitOrClean

      protected void commitOrClean(Set<RewriteFileGroup> batch)
      Perform a commit operation on the table for the set of file groups, should cleanup failed file groups.
      Parameters:
      batch - set of file groups

    • abortFileGroup

      protected void abortFileGroup(RewriteFileGroup group)
      Clean up a specified file set by removing any files created for that operation, should not throw any exceptions
      Parameters:
      group - group of files which are not yet committed

    • start

      public void start()
      Starts a single threaded executor service for handling file group commits.

    • offer

      public void offer(RewriteFileGroup group)
      Places a file group in the queue and commits a batch of file groups if BaseCommitService.rewritesPerCommit number of file groups are present in the queue.
      Parameters:
      group - file group to eventually be committed

    • results

      public List<RewriteFileGroup> results()
      Returns all File groups which have been committed

    • close

      public void close()
      Specified by:
      close in interface AutoCloseable
      Specified by:
      close in interface Closeable

    • succeededCommits

      public int succeededCommits()