Class AllFilesTable.AllFilesTableScan

    • Method Detail

      • manifests

        protected CloseableIterable<ManifestFile> manifests()
        Returns an iterable of manifest files to explore for this all files metadata table scan
      • useSnapshot

        public TableScan useSnapshot​(long scanSnapshotId)
        Description copied from interface: TableScan
        Create a new TableScan from this scan's configuration that will use the given snapshot by ID.
        Specified by:
        useSnapshot in interface TableScan
        Parameters:
        scanSnapshotId - a snapshot ID
        Returns:
        a new scan based on this with the given snapshot ID
      • asOfTime

        public TableScan asOfTime​(long timestampMillis)
        Description copied from interface: TableScan
        Create a new TableScan from this scan's configuration that will use the most recent snapshot as of the given time in milliseconds.
        Specified by:
        asOfTime in interface TableScan
        Parameters:
        timestampMillis - a timestamp in milliseconds.
        Returns:
        a new scan based on this with the current snapshot at the given time
      • appendsBetween

        public TableScan appendsBetween​(long fromSnapshotId,
                                        long toSnapshotId)
        Description copied from interface: TableScan
        Create a new TableScan to read appended data from fromSnapshotId exclusive to toSnapshotId inclusive.
        Specified by:
        appendsBetween in interface TableScan
        Parameters:
        fromSnapshotId - the last snapshot id read by the user, exclusive
        toSnapshotId - read append data up to this snapshot id
        Returns:
        a table scan which can read append data from fromSnapshotId exclusive and up to toSnapshotId inclusive
      • appendsAfter

        public TableScan appendsAfter​(long fromSnapshotId)
        Description copied from interface: TableScan
        Create a new TableScan to read appended data from fromSnapshotId exclusive to the current snapshot inclusive.
        Specified by:
        appendsAfter in interface TableScan
        Parameters:
        fromSnapshotId - - the last snapshot id read by the user, exclusive
        Returns:
        a table scan which can read append data from fromSnapshotId exclusive and up to current snapshot inclusive
      • snapshotId

        protected java.lang.Long snapshotId()
      • colStats

        protected boolean colStats()
      • shouldIgnoreResiduals

        protected boolean shouldIgnoreResiduals()
      • planExecutor

        protected java.util.concurrent.ExecutorService planExecutor()
      • options

        protected java.util.Map<java.lang.String,​java.lang.String> options()
      • table

        public Table table()
        Description copied from interface: TableScan
        Returns the Table from which this scan loads data.
        Specified by:
        table in interface TableScan
        Returns:
        this scan's table
      • planTasks

        public CloseableIterable<CombinedScanTask> planTasks()
        Description copied from interface: Scan
        Plan balanced task groups for this scan by splitting large and combining small tasks.

        Task groups created by this method may read partial input files, multiple input files or both.

        Specified by:
        planTasks in interface Scan<TableScan,​FileScanTask,​CombinedScanTask>
        Returns:
        an Iterable of balanced task groups required by this scan
      • isCaseSensitive

        public boolean isCaseSensitive()
        Description copied from interface: TableScan
        Returns whether this scan should apply column name case sensitiveness as per Scan.caseSensitive(boolean).
        Specified by:
        isCaseSensitive in interface TableScan
        Returns:
        true if case sensitive, false otherwise.
      • toString

        public java.lang.String toString()
        Overrides:
        toString in class java.lang.Object
      • tableSchema

        protected Schema tableSchema()
      • context

        protected org.apache.iceberg.TableScanContext context()
      • option

        public ThisT option​(java.lang.String property,
                            java.lang.String value)
        Description copied from interface: Scan
        Create a new scan from this scan's configuration that will override the Table's behavior based on the incoming pair. Unknown properties will be ignored.
        Specified by:
        option in interface Scan<ThisT,​T extends ScanTask,​G extends ScanTaskGroup<T>>
        Parameters:
        property - name of the table property to be overridden
        value - value to override with
        Returns:
        a new scan based on this with overridden behavior
      • project

        public ThisT project​(Schema projectedSchema)
        Description copied from interface: Scan
        Create a new scan from this with the schema as its projection.
        Specified by:
        project in interface Scan<ThisT,​T extends ScanTask,​G extends ScanTaskGroup<T>>
        Parameters:
        projectedSchema - a projection schema
        Returns:
        a new scan based on this with the given projection
      • caseSensitive

        public ThisT caseSensitive​(boolean caseSensitive)
        Description copied from interface: Scan
        Create a new scan from this that, if data columns where selected via Scan.select(java.util.Collection), controls whether the match to the schema will be done with case sensitivity. Default is true.
        Specified by:
        caseSensitive in interface Scan<ThisT,​T extends ScanTask,​G extends ScanTaskGroup<T>>
        Returns:
        a new scan based on this with case sensitivity as stated
      • includeColumnStats

        public ThisT includeColumnStats()
        Description copied from interface: Scan
        Create a new scan from this that loads the column stats with each data file.

        Column stats include: value count, null value count, lower bounds, and upper bounds.

        Specified by:
        includeColumnStats in interface Scan<ThisT,​T extends ScanTask,​G extends ScanTaskGroup<T>>
        Returns:
        a new scan based on this that loads column stats.
      • select

        public ThisT select​(java.util.Collection<java.lang.String> columns)
        Description copied from interface: Scan
        Create a new scan from this that will read the given data columns. This produces an expected schema that includes all fields that are either selected or used by this scan's filter expression.
        Specified by:
        select in interface Scan<ThisT,​T extends ScanTask,​G extends ScanTaskGroup<T>>
        Parameters:
        columns - column names from the table's schema
        Returns:
        a new scan based on this with the given projection columns
      • filter

        public ThisT filter​(Expression expr)
        Description copied from interface: Scan
        Create a new scan from the results of this filtered by the Expression.
        Specified by:
        filter in interface Scan<ThisT,​T extends ScanTask,​G extends ScanTaskGroup<T>>
        Parameters:
        expr - a filter expression
        Returns:
        a new scan based on this with results filtered by the expression
      • ignoreResiduals

        public ThisT ignoreResiduals()
        Description copied from interface: Scan
        Create a new scan from this that applies data filtering to files but not to rows in those files.
        Specified by:
        ignoreResiduals in interface Scan<ThisT,​T extends ScanTask,​G extends ScanTaskGroup<T>>
        Returns:
        a new scan based on this that does not filter rows in files.
      • planWith

        public ThisT planWith​(java.util.concurrent.ExecutorService executorService)
        Description copied from interface: Scan
        Create a new scan to use a particular executor to plan. The default worker pool will be used by default.
        Specified by:
        planWith in interface Scan<ThisT,​T extends ScanTask,​G extends ScanTaskGroup<T>>
        Parameters:
        executorService - the provided executor
        Returns:
        a table scan that uses the provided executor to access manifests
      • schema

        public Schema schema()
        Description copied from interface: Scan
        Returns this scan's projection Schema.

        If the projection schema was set directly using Scan.project(Schema), returns that schema.

        If the projection schema was set by calling Scan.select(Collection), returns a projection schema that includes the selected data fields and any fields used in the filter expression.

        Specified by:
        schema in interface Scan<ThisT,​T extends ScanTask,​G extends ScanTaskGroup<T>>
        Returns:
        this scan's projection schema
      • splitLookback

        public int splitLookback()
        Description copied from interface: Scan
        Returns the split lookback for this scan.
        Specified by:
        splitLookback in interface Scan<ThisT,​T extends ScanTask,​G extends ScanTaskGroup<T>>
      • splitOpenFileCost

        public long splitOpenFileCost()
        Description copied from interface: Scan
        Returns the split open file cost for this scan.
        Specified by:
        splitOpenFileCost in interface Scan<ThisT,​T extends ScanTask,​G extends ScanTaskGroup<T>>