Package org.apache.iceberg.flink.maintenance.operator

Class MonitorSource

java.lang.Object

org.apache.iceberg.flink.maintenance.operator.SingleThreadedIteratorSource<TableChange>

org.apache.iceberg.flink.maintenance.operator.MonitorSource

All Implemented Interfaces:

Serializable, org.apache.flink.api.connector.source.Source<TableChange,org.apache.iceberg.flink.maintenance.operator.SingleThreadedIteratorSource.GlobalSplit<TableChange>,Collection<org.apache.iceberg.flink.maintenance.operator.SingleThreadedIteratorSource.GlobalSplit<TableChange>>>, org.apache.flink.api.connector.source.SourceReaderFactory<TableChange,org.apache.iceberg.flink.maintenance.operator.SingleThreadedIteratorSource.GlobalSplit<TableChange>>, org.apache.flink.api.java.typeutils.ResultTypeQueryable<TableChange>

@Internal
public class MonitorSource
extends SingleThreadedIteratorSource<TableChange>

Monitors an Iceberg table for changes

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
MonitorSource(TableLoader tableLoader, org.apache.flink.api.connector.source.util.ratelimit.RateLimiterStrategy rateLimiterStrategy, long maxReadBack)	Creates a Source which monitors an Iceberg table for changes.

Method Summary

Modifier and Type	Method	Description
org.apache.flink.api.connector.source.SourceReader<TableChange,org.apache.iceberg.flink.maintenance.operator.SingleThreadedIteratorSource.GlobalSplit<TableChange>>	createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)
org.apache.flink.api.connector.source.Boundedness	getBoundedness()
org.apache.flink.api.common.typeinfo.TypeInformation<TableChange>	getProducedType()

Methods inherited from class org.apache.iceberg.flink.maintenance.operator.SingleThreadedIteratorSource

createEnumerator, getEnumeratorCheckpointSerializer, getSplitSerializer, restoreEnumerator

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.connector.source.Source

declareWatermarks

Constructor Details

MonitorSource

public MonitorSource(TableLoader tableLoader,
 org.apache.flink.api.connector.source.util.ratelimit.RateLimiterStrategy rateLimiterStrategy,
 long maxReadBack)

Creates a Source which monitors an Iceberg table for changes.

Parameters:

tableLoader - used for accessing the table

rateLimiterStrategy - limits the frequency the table is checked

maxReadBack - sets the number of snapshots read before stopping change collection

Method Details

getBoundedness

public org.apache.flink.api.connector.source.Boundedness getBoundedness()

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<TableChange> getProducedType()

createReader

public org.apache.flink.api.connector.source.SourceReader<TableChange,org.apache.iceberg.flink.maintenance.operator.SingleThreadedIteratorSource.GlobalSplit<TableChange>> createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)
                                                                                                                                                                                 throws Exception

Specified by:

createReader in interface org.apache.flink.api.connector.source.SourceReaderFactory<TableChange,org.apache.iceberg.flink.maintenance.operator.SingleThreadedIteratorSource.GlobalSplit<TableChange>>

Overrides:

createReader in class SingleThreadedIteratorSource<TableChange>

Throws:

Exception