Class ComputeUpdateIterator

  • All Implemented Interfaces:
    java.util.Iterator<org.apache.spark.sql.Row>

    public class ComputeUpdateIterator
    extends ChangelogIterator
    An iterator that finds delete/insert rows which represent an update, and converts them into update records from changelog tables within a single Spark task. It assumes that rows are sorted by identifier columns and change type.

    For example, these two rows

    • (id=1, data='a', op='DELETE')
    • (id=1, data='b', op='INSERT')

    will be marked as update-rows:

    • (id=1, data='a', op='UPDATE_BEFORE')
    • (id=1, data='b', op='UPDATE_AFTER')
    • Method Detail

      • hasNext

        public boolean hasNext()
      • next

        public org.apache.spark.sql.Row next()