org.apache.iceberg.flink.source.enumerator

Class StaticIcebergEnumerator

java.lang.Object

org.apache.iceberg.flink.source.enumerator.StaticIcebergEnumerator

All Implemented Interfaces:

java.lang.AutoCloseable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.connector.source.SplitEnumerator<IcebergSourceSplit,IcebergEnumeratorState>

@Internal
public class StaticIcebergEnumerator
extends java.lang.Object

One-time split enumeration at the start-up for batch execution

Constructor Summary

Constructors

Constructor and Description
StaticIcebergEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<IcebergSourceSplit> enumeratorContext, SplitAssigner assigner, Table table, ScanContext scanContext, IcebergEnumeratorState enumState)

Method Summary

Modifier and Type	Method and Description
void	addReader(int subtaskId)
void	addSplitsBack(java.util.List<IcebergSourceSplit> splits, int subtaskId)
void	close()
void	handleSourceEvent(int subtaskId, org.apache.flink.api.connector.source.SourceEvent sourceEvent)
void	handleSplitRequest(int subtaskId, java.lang.String requesterHostname)
protected boolean	shouldWaitForMoreSplits() return true if enumerator should wait for splits like in the continuous enumerator case
IcebergEnumeratorState	snapshotState(long checkpointId)
void	start()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.connector.source.SplitEnumerator

notifyCheckpointComplete

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted

Constructor Detail

StaticIcebergEnumerator

public StaticIcebergEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<IcebergSourceSplit> enumeratorContext,
                               SplitAssigner assigner,
                               Table table,
                               ScanContext scanContext,
                               @Nullable
                               IcebergEnumeratorState enumState)

Method Detail

start

public void start()

Specified by:

start in interface org.apache.flink.api.connector.source.SplitEnumerator<IcebergSourceSplit,IcebergEnumeratorState>

shouldWaitForMoreSplits

protected boolean shouldWaitForMoreSplits()

return true if enumerator should wait for splits like in the continuous enumerator case

snapshotState

public IcebergEnumeratorState snapshotState(long checkpointId)

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface org.apache.flink.api.connector.source.SplitEnumerator<IcebergSourceSplit,IcebergEnumeratorState>

Throws:

java.io.IOException

handleSplitRequest

public void handleSplitRequest(int subtaskId,
                               @Nullable
                               java.lang.String requesterHostname)

Specified by:

handleSplitRequest in interface org.apache.flink.api.connector.source.SplitEnumerator<IcebergSourceSplit,IcebergEnumeratorState>

handleSourceEvent

public void handleSourceEvent(int subtaskId,
                              org.apache.flink.api.connector.source.SourceEvent sourceEvent)

Specified by:

handleSourceEvent in interface org.apache.flink.api.connector.source.SplitEnumerator<IcebergSourceSplit,IcebergEnumeratorState>

addSplitsBack

public void addSplitsBack(java.util.List<IcebergSourceSplit> splits,
                          int subtaskId)

Specified by:

addSplitsBack in interface org.apache.flink.api.connector.source.SplitEnumerator<IcebergSourceSplit,IcebergEnumeratorState>

addReader

public void addReader(int subtaskId)

Specified by:

addReader in interface org.apache.flink.api.connector.source.SplitEnumerator<IcebergSourceSplit,IcebergEnumeratorState>