Class ColumnStatsWatermarkExtractor

    • Constructor Summary

      Constructors 
      Constructor Description
      ColumnStatsWatermarkExtractor​(Schema schema, java.lang.String eventTimeFieldName, java.util.concurrent.TimeUnit timeUnit)
      Creates the extractor.
    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      long extractWatermark​(IcebergSourceSplit split)
      Get the watermark for a split using column statistics.
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Constructor Detail

      • ColumnStatsWatermarkExtractor

        public ColumnStatsWatermarkExtractor​(Schema schema,
                                             java.lang.String eventTimeFieldName,
                                             java.util.concurrent.TimeUnit timeUnit)
        Creates the extractor.
        Parameters:
        schema - The schema of the Table
        eventTimeFieldName - The column which should be used as an event time
        timeUnit - Used for converting the long value to epoch milliseconds
    • Method Detail

      • extractWatermark

        public long extractWatermark​(IcebergSourceSplit split)
        Get the watermark for a split using column statistics.
        Specified by:
        extractWatermark in interface SplitWatermarkExtractor
        Parameters:
        split - The split
        Returns:
        The watermark
        Throws:
        java.lang.IllegalArgumentException - if there is no statistics for the column