Package org.apache.iceberg.flink.maintenance.operator

Class EqualityConvertReader

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.ProcessFunction<ReadCommand,IndexCommand>

org.apache.iceberg.flink.maintenance.operator.EqualityConvertReader

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction

@Internal
public class EqualityConvertReader
extends org.apache.flink.streaming.api.functions.ProcessFunction<ReadCommand,IndexCommand>

Parallel reader that processes ReadCommands from the planner and emits IndexCommands. Dispatches on the wrapped ContentScanTask subtype: FileScanTask (data file) emits ADD_DATA_ROW per row, our equality-delete task emits RESOLVE_DELETE per row.

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

Field Summary

Fields

Modifier and Type	Field	Description
static final org.apache.flink.util.OutputTag<DVPosition>	READER_ABORT_STREAM

Constructor Summary

Constructors

Constructor	Description
EqualityConvertReader(TableLoader tableLoader, Set<Integer> eqFieldIds, boolean stagingOnTargetBranch)

Method Summary

Modifier and Type	Method	Description
void	close()
void	open(org.apache.flink.api.common.functions.OpenContext openContext)
void	processElement(ReadCommand cmd, org.apache.flink.streaming.api.functions.ProcessFunction<ReadCommand,IndexCommand>.org.apache.flink.streaming.api.functions.ProcessFunction.Context ctx, org.apache.flink.util.Collector<IndexCommand> out)

Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

onTimer

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.common.functions.RichFunction

useInterruptibleTimers

Field Details

READER_ABORT_STREAM

public static final org.apache.flink.util.OutputTag<DVPosition> READER_ABORT_STREAM

Constructor Details

EqualityConvertReader

public EqualityConvertReader(TableLoader tableLoader,
 Set<Integer> eqFieldIds,
 boolean stagingOnTargetBranch)

Method Details

open

public void open(org.apache.flink.api.common.functions.OpenContext openContext)
          throws Exception

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception

processElement

public void processElement(ReadCommand cmd,
 org.apache.flink.streaming.api.functions.ProcessFunction<ReadCommand,IndexCommand>.org.apache.flink.streaming.api.functions.ProcessFunction.Context ctx,
 org.apache.flink.util.Collector<IndexCommand> out)
                    throws Exception

Specified by:

processElement in class org.apache.flink.streaming.api.functions.ProcessFunction<ReadCommand,IndexCommand>

Throws:

Exception

close

public void close()
           throws Exception

Specified by:

close in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

close in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception