Package org.apache.iceberg.flink
Class FlinkWriteConf
java.lang.Object
org.apache.iceberg.flink.FlinkWriteConf
A class for common Iceberg configs for Flink writes.
If a config is set at multiple levels, the following order of precedence is used (top to bottom):
- Write options
- flink ReadableConfig
- Table metadata
Note this class is NOT meant to be serialized.
-
Constructor Summary
ConstructorDescriptionFlinkWriteConf
(Table table, Map<String, String> writeOptions, org.apache.flink.configuration.ReadableConfig readableConfig) -
Method Summary
Modifier and TypeMethodDescriptionbranch()
boolean
NOTE: This may be removed or changed in a future release.long
boolean
int
-
Constructor Details
-
FlinkWriteConf
-
-
Method Details
-
overwriteMode
public boolean overwriteMode() -
upsertMode
public boolean upsertMode() -
dataFileFormat
-
targetDataFileSize
public long targetDataFileSize() -
parquetCompressionCodec
-
parquetCompressionLevel
-
avroCompressionCodec
-
avroCompressionLevel
-
orcCompressionCodec
-
orcCompressionStrategy
-
distributionMode
-
workerPoolSize
public int workerPoolSize() -
branch
-
writeParallelism
-
tableRefreshInterval
NOTE: This may be removed or changed in a future release. This value specifies the interval for refreshing the table instances in sink writer subtasks. If not specified then the default behavior is to not refresh the table.- Returns:
- the interval for refreshing the table in sink writer subtasks
-