Package org.apache.iceberg.flink

Class FlinkWriteConf

java.lang.Object

org.apache.iceberg.flink.FlinkWriteConf

public class FlinkWriteConf
extends java.lang.Object

A class for common Iceberg configs for Flink writes.

If a config is set at multiple levels, the following order of precedence is used (top to bottom):

1. Write options
2. flink ReadableConfig
3. Table metadata

The most specific value is set in write options and takes precedence over all other configs. If no write option is provided, this class checks the flink configuration for any overrides. If no applicable value is found in the write options, this class uses the table metadata.

Note this class is NOT meant to be serialized.

Constructor Summary

Constructors

Constructor	Description
FlinkWriteConf(Table table, java.util.Map<java.lang.String,java.lang.String> writeOptions, org.apache.flink.configuration.ReadableConfig readableConfig)

Method Summary

Modifier and Type	Method	Description
FileFormat	dataFileFormat()
DistributionMode	distributionMode()
boolean	overwriteMode()
long	targetDataFileSize()
boolean	upsertMode()
int	workerPoolSize()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FlinkWriteConf

public FlinkWriteConf(Table table,
                      java.util.Map<java.lang.String,java.lang.String> writeOptions,
                      org.apache.flink.configuration.ReadableConfig readableConfig)

Method Detail

overwriteMode

public boolean overwriteMode()

upsertMode

public boolean upsertMode()

dataFileFormat

public FileFormat dataFileFormat()

targetDataFileSize

public long targetDataFileSize()

distributionMode

public DistributionMode distributionMode()

workerPoolSize

public int workerPoolSize()