Package org.apache.iceberg.flink.sink

Class FlinkSink

java.lang.Object
org.apache.iceberg.flink.sink.FlinkSink
public class FlinkSink extends Object

  • Nested Class Summary

    Nested Classes
    Modifier and Type
    Class
    Description
    static class 
    FlinkSink.Builder
     

  • Method Summary

    Modifier and Type
    Method
    Description
    static <T> FlinkSink.Builder
    builderFor(org.apache.flink.streaming.api.datastream.DataStream<T> input, org.apache.flink.api.common.functions.MapFunction<T,org.apache.flink.table.data.RowData> mapper, org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.table.data.RowData> outputType)
    Initialize a FlinkSink.Builder to export the data from generic input data stream into iceberg table.
    static FlinkSink.Builder
    forRow(org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.types.Row> input, org.apache.flink.table.catalog.ResolvedSchema resolvedSchema)
    Initialize a FlinkSink.Builder to export the data from input data stream with Rows into iceberg table.
    static FlinkSink.Builder
    forRow(org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.types.Row> input, org.apache.flink.table.legacy.api.TableSchema tableSchema)
    Deprecated.
    since 1.10.0, will be removed in 2.0.0.
    static FlinkSink.Builder
    forRowData(org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData> input)
    Initialize a FlinkSink.Builder to export the data from input data stream with RowDatas into iceberg table.

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Method Details

    • builderFor

      public static <T> FlinkSink.Builder builderFor(org.apache.flink.streaming.api.datastream.DataStream<T> input, org.apache.flink.api.common.functions.MapFunction<T,org.apache.flink.table.data.RowData> mapper, org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.table.data.RowData> outputType)
      Initialize a FlinkSink.Builder to export the data from generic input data stream into iceberg table. We use RowData inside the sink connector, so users need to provide a mapper function and a TypeInformation to convert those generic records to a RowData DataStream.
      Type Parameters:
      T - the data type of records.
      Parameters:
      input - the generic source input data stream.
      mapper - function to convert the generic data to RowData
      outputType - to define the TypeInformation for the input data.
      Returns:
      FlinkSink.Builder to connect the iceberg table.

    • forRow

      @Deprecated public static FlinkSink.Builder forRow(org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.types.Row> input, org.apache.flink.table.legacy.api.TableSchema tableSchema)
      Deprecated.
      since 1.10.0, will be removed in 2.0.0. Use forRow(DataStream, ResolvedSchema) instead.
      Initialize a FlinkSink.Builder to export the data from input data stream with Rows into iceberg table. We use RowData inside the sink connector, so users need to provide a TableSchema for builder to convert those Rows to a RowData DataStream.
      Parameters:
      input - the source input data stream with Rows.
      tableSchema - defines the TypeInformation for input data.
      Returns:
      FlinkSink.Builder to connect the iceberg table.

    • forRow

      public static FlinkSink.Builder forRow(org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.types.Row> input, org.apache.flink.table.catalog.ResolvedSchema resolvedSchema)
      Initialize a FlinkSink.Builder to export the data from input data stream with Rows into iceberg table. We use RowData inside the sink connector, so users need to provide a ResolvedSchema for builder to convert those Rows to a RowData DataStream.
      Parameters:
      input - the source input data stream with Rows.
      resolvedSchema - defines the TypeInformation for input data.
      Returns:
      FlinkSink.Builder to connect the iceberg table.

    • forRowData

      public static FlinkSink.Builder forRowData(org.apache.flink.streaming.api.datastream.DataStream<org.apache.flink.table.data.RowData> input)
      Initialize a FlinkSink.Builder to export the data from input data stream with RowDatas into iceberg table.
      Parameters:
      input - the source input data stream with RowDatas.
      Returns:
      FlinkSink.Builder to connect the iceberg table.