Package org.apache.iceberg.util

Class ThreadPools

java.lang.Object
org.apache.iceberg.util.ThreadPools
public class ThreadPools extends Object

  • Field Details

    • WORKER_THREAD_POOL_SIZE_PROP

      @Deprecated public static final String WORKER_THREAD_POOL_SIZE_PROP
      Deprecated.
      Use WORKER_THREAD_POOL_SIZE instead; will be removed in 2.0.0

    • WORKER_THREAD_POOL_SIZE

      public static final int WORKER_THREAD_POOL_SIZE

    • DELETE_WORKER_THREAD_POOL_SIZE

      public static final int DELETE_WORKER_THREAD_POOL_SIZE

  • Method Details

    • getWorkerPool

      public static ExecutorService getWorkerPool()
      Return an ExecutorService that uses the "worker" thread-pool.

      The size of the worker pool limits the number of tasks concurrently reading manifests in the base table implementation across all concurrent planning operations.

      The size of this thread-pool is controlled by the Java system property iceberg.worker.num-threads.

      Returns:
      an ExecutorService that uses the worker pool

    • getDeleteWorkerPool

      public static ExecutorService getDeleteWorkerPool()
      Return an ExecutorService that uses the "delete worker" thread-pool.

      The size of this worker pool limits the number of tasks concurrently reading delete files within a single JVM. If there are multiple threads loading deletes, all of them will share this worker pool by default.

      The size of this thread-pool is controlled by the Java system property iceberg.worker.delete-num-threads.

      Returns:
      an ExecutorService that uses the delete worker pool

    • newWorkerPool

      public static ExecutorService newWorkerPool(String namePrefix)

    • newWorkerPool

      public static ExecutorService newWorkerPool(String namePrefix, int poolSize)

    • newScheduledPool

      public static ScheduledExecutorService newScheduledPool(String namePrefix, int poolSize)
      Create a new ScheduledExecutorService with the given name and pool size.

      Threads used by this service will be daemon threads.

      Parameters:
      namePrefix - a base name for threads in the executor service's thread pool
      poolSize - max number of threads to use
      Returns:
      an executor service