Package org.apache.iceberg.flink.sink.dynamic

Class DynamicRecord

java.lang.Object

org.apache.iceberg.flink.sink.dynamic.DynamicRecord

public class DynamicRecord
extends Object

A DynamicRecord contains RowData alongside with the Iceberg table metadata.

Constructor Summary

Constructors

Constructor	Description
DynamicRecord(TableIdentifier tableIdentifier, String branch, Schema schema, org.apache.flink.table.data.RowData rowData, PartitionSpec partitionSpec)	Constructs a new DynamicRecord with forward (no shuffle) writes.
DynamicRecord(TableIdentifier tableIdentifier, String branch, Schema schema, org.apache.flink.table.data.RowData rowData, PartitionSpec partitionSpec, DistributionMode distributionMode, int writeParallelism)	Constructs a new DynamicRecord.

Method Summary

Modifier and Type	Method	Description
String	branch()
DistributionMode	distributionMode()
Set<String>	equalityFields()
org.apache.flink.table.data.RowData	rowData()
Schema	schema()
void	setBranch(String branch)
void	setDistributionMode(DistributionMode distributionMode)
void	setEqualityFields(Set<String> equalityFields)
void	setPartitionSpec(PartitionSpec partitionSpec)
void	setRowData(org.apache.flink.table.data.RowData rowData)
void	setSchema(Schema schema)
void	setTableIdentifier(TableIdentifier tableIdentifier)
void	setUpsertMode(boolean upsertMode)
PartitionSpec	spec()
TableIdentifier	tableIdentifier()
boolean	upsertMode()
int	writeParallelism()
void	writeParallelism(int parallelism)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

DynamicRecord

public DynamicRecord(TableIdentifier tableIdentifier,
 String branch,
 Schema schema,
 org.apache.flink.table.data.RowData rowData,
 PartitionSpec partitionSpec)

Constructs a new DynamicRecord with forward (no shuffle) writes.

Parameters:

tableIdentifier - The target table identifier.

branch - The target table branch.

schema - The target table schema.

rowData - The data matching the provided schema.

partitionSpec - The target table PartitionSpec.

DynamicRecord

public DynamicRecord(TableIdentifier tableIdentifier,
 String branch,
 Schema schema,
 org.apache.flink.table.data.RowData rowData,
 PartitionSpec partitionSpec,
 DistributionMode distributionMode,
 int writeParallelism)

Constructs a new DynamicRecord. This record will be shuffled as specified by distributionMode.

Parameters:

tableIdentifier - The target table identifier.

branch - The target table branch.

schema - The target table schema.

rowData - The data matching the provided schema.

partitionSpec - The target table PartitionSpec.

distributionMode - The DistributionMode. null indicates forward (no shuffle) writes.

writeParallelism - The number of parallel writers. Can be set to any value > 0, but will always be automatically capped by the maximum write parallelism, which is the parallelism of the sink. Set to Integer.MAX_VALUE for always using the maximum available write parallelism.

Method Details

tableIdentifier

public TableIdentifier tableIdentifier()

setTableIdentifier

public void setTableIdentifier(TableIdentifier tableIdentifier)

branch

public String branch()

setBranch

public void setBranch(String branch)

schema

public Schema schema()

setSchema

public void setSchema(Schema schema)

spec

public PartitionSpec spec()

setPartitionSpec

public void setPartitionSpec(PartitionSpec partitionSpec)

rowData

public org.apache.flink.table.data.RowData rowData()

setRowData

public void setRowData(org.apache.flink.table.data.RowData rowData)

distributionMode

public DistributionMode distributionMode()

setDistributionMode

public void setDistributionMode(DistributionMode distributionMode)

writeParallelism

public int writeParallelism()

writeParallelism

public void writeParallelism(int parallelism)

upsertMode

public boolean upsertMode()

setUpsertMode

public void setUpsertMode(boolean upsertMode)

equalityFields

public Set<String> equalityFields()

setEqualityFields

public void setEqualityFields(Set<String> equalityFields)