Class RewriteDataFilesCommitManager.CommitService

  • All Implemented Interfaces:
    java.io.Closeable, java.lang.AutoCloseable
    Enclosing class:
    RewriteDataFilesCommitManager

    public class RewriteDataFilesCommitManager.CommitService
    extends java.lang.Object
    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      protected void abortFileGroup​(RewriteFileGroup group)
      Clean up a specified file set by removing any files created for that operation, should not throw any exceptions
      void close()  
      protected void commitOrClean​(java.util.Set<RewriteFileGroup> batch)
      Perform a commit operation on the table for the set of file groups, should cleanup failed file groups.
      void offer​(T group)
      Places a file group in the queue and commits a batch of file groups if rewritesPerCommit number of file groups are present in the queue.
      java.util.List<T> results()
      Returns all File groups which have been committed
      void start()
      Starts a single threaded executor service for handling file group commits.
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Field Detail

      • TIMEOUT_IN_MS_DEFAULT

        public static final long TIMEOUT_IN_MS_DEFAULT
    • Method Detail

      • commitOrClean

        protected void commitOrClean​(java.util.Set<RewriteFileGroup> batch)
        Perform a commit operation on the table for the set of file groups, should cleanup failed file groups.
        Parameters:
        batch - set of file groups
      • abortFileGroup

        protected void abortFileGroup​(RewriteFileGroup group)
        Clean up a specified file set by removing any files created for that operation, should not throw any exceptions
        Parameters:
        group - group of files which are not yet committed
      • start

        public void start()
        Starts a single threaded executor service for handling file group commits.
      • offer

        public void offer​(T group)
        Places a file group in the queue and commits a batch of file groups if rewritesPerCommit number of file groups are present in the queue.
        Parameters:
        group - file group to eventually be committed
      • results

        public java.util.List<T> results()
        Returns all File groups which have been committed
      • close

        public void close()
        Specified by:
        close in interface java.lang.AutoCloseable
        Specified by:
        close in interface java.io.Closeable