Package org.apache.iceberg.flink.maintenance.api

Class RewriteDataFilesConfig

java.lang.Object
org.apache.iceberg.flink.maintenance.api.RewriteDataFilesConfig
public class RewriteDataFilesConfig extends Object

  • Field Details

    • PREFIX

      public static final String PREFIX
      See Also:

    • MAX_BYTES

      public static final String MAX_BYTES
      See Also:

    • MAX_BYTES_OPTION

      public static final org.apache.flink.configuration.ConfigOption<Long> MAX_BYTES_OPTION

    • PARTIAL_PROGRESS_MAX_COMMITS_OPTION

      public static final org.apache.flink.configuration.ConfigOption<Integer> PARTIAL_PROGRESS_MAX_COMMITS_OPTION

    • PARTIAL_PROGRESS_ENABLED_OPTION

      public static final org.apache.flink.configuration.ConfigOption<Boolean> PARTIAL_PROGRESS_ENABLED_OPTION

    • SCHEDULE_ON_COMMIT_COUNT

      public static final String SCHEDULE_ON_COMMIT_COUNT
      See Also:

    • SCHEDULE_ON_COMMIT_COUNT_OPTION

      public static final org.apache.flink.configuration.ConfigOption<Integer> SCHEDULE_ON_COMMIT_COUNT_OPTION

    • SCHEDULE_ON_DATA_FILE_COUNT

      public static final String SCHEDULE_ON_DATA_FILE_COUNT
      See Also:

    • SCHEDULE_ON_DATA_FILE_COUNT_OPTION

      public static final org.apache.flink.configuration.ConfigOption<Integer> SCHEDULE_ON_DATA_FILE_COUNT_OPTION

    • SCHEDULE_ON_DATA_FILE_SIZE

      public static final String SCHEDULE_ON_DATA_FILE_SIZE
      See Also:

    • SCHEDULE_ON_DATA_FILE_SIZE_OPTION

      public static final org.apache.flink.configuration.ConfigOption<Long> SCHEDULE_ON_DATA_FILE_SIZE_OPTION

    • SCHEDULE_ON_INTERVAL_SECOND

      public static final String SCHEDULE_ON_INTERVAL_SECOND
      See Also:

    • SCHEDULE_ON_INTERVAL_SECOND_OPTION

      public static final org.apache.flink.configuration.ConfigOption<Long> SCHEDULE_ON_INTERVAL_SECOND_OPTION

  • Constructor Details

    • RewriteDataFilesConfig

      public RewriteDataFilesConfig(Table table, Map<String,String> writeOptions, org.apache.flink.configuration.ReadableConfig readableConfig)

  • Method Details

    • scheduleOnCommitCount

      public int scheduleOnCommitCount()
      Gets the number of commits that trigger a rewrite operation.

    • scheduleOnDataFileCount

      public int scheduleOnDataFileCount()
      Gets the number of data files that trigger a rewrite operation.

    • scheduleOnDataFileSize

      public long scheduleOnDataFileSize()
      Gets the total size of data files that trigger a rewrite operation.

    • scheduleOnIntervalSecond

      public long scheduleOnIntervalSecond()
      Gets the time interval (in seconds) between two consecutive rewrite operations.

    • partialProgressEnable

      public boolean partialProgressEnable()
      Gets whether partial progress commits are enabled.

    • partialProgressMaxCommits

      public int partialProgressMaxCommits()
      Gets the maximum number of commits allowed for partial progress.

    • maxRewriteBytes

      public long maxRewriteBytes()
      Gets the maximum rewrite bytes allowed for a single rewrite operation.

    • properties

      public Map<String,String> properties()