Package org.apache.iceberg.flink.sink

Class FlinkManifestUtil

java.lang.Object

org.apache.iceberg.flink.sink.FlinkManifestUtil

public class FlinkManifestUtil
extends Object

Method Summary

Modifier and Type	Method	Description
static ManifestOutputFileFactory	createOutputFileFactory(Supplier<Table> tableSupplier, Map<String,String> tableProps, String flinkJobId, String operatorUniqueId, int subTaskId, long attemptNumber)
static void	deleteCommittedManifests(Table table, List<ManifestFile> manifests, String newFlinkJobId, long checkpointId)
static WriteResult	readCompletedFiles(DeltaManifests deltaManifests, FileIO io, Map<Integer,PartitionSpec> specsById)
static DeltaManifests	writeCompletedFiles(WriteResult result, Supplier<OutputFile> outputFileSupplier, PartitionSpec spec)	Write the WriteResult to temporary manifest files.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

createOutputFileFactory

public static ManifestOutputFileFactory createOutputFileFactory(Supplier<Table> tableSupplier,
 Map<String,String> tableProps,
 String flinkJobId,
 String operatorUniqueId,
 int subTaskId,
 long attemptNumber)

writeCompletedFiles

public static DeltaManifests writeCompletedFiles(WriteResult result,
 Supplier<OutputFile> outputFileSupplier,
 PartitionSpec spec)
                                          throws IOException

Write the WriteResult to temporary manifest files.

Parameters:

result - all those DataFiles/DeleteFiles in this WriteResult should be written with same partition spec

Throws:

IOException

readCompletedFiles

public static WriteResult readCompletedFiles(DeltaManifests deltaManifests,
 FileIO io,
 Map<Integer,PartitionSpec> specsById)
                                      throws IOException

Throws:

IOException

deleteCommittedManifests

public static void deleteCommittedManifests(Table table,
 List<ManifestFile> manifests,
 String newFlinkJobId,
 long checkpointId)