Package org.apache.iceberg.util
Class TableScanUtil
java.lang.Object
org.apache.iceberg.util.TableScanUtil
-
Method Summary
Modifier and TypeMethodDescriptionstatic long
adjustSplitSize
(long scanSize, int parallelism, long splitSize) static boolean
hasDeletes
(CombinedScanTask task) static boolean
hasDeletes
(FileScanTask task) static boolean
hasEqDeletes
(CombinedScanTask task) This is temporarily introduced since we plan to support pos-delete vectorized read first, then get to the equality-delete support.mergeTasks
(List<T> tasks) static <T extends ScanTask>
List<ScanTaskGroup<T>> planTaskGroups
(List<T> tasks, long splitSize, int lookback, long openFileCost) static <T extends PartitionScanTask>
List<ScanTaskGroup<T>> planTaskGroups
(List<T> tasks, long splitSize, int lookback, long openFileCost, Types.StructType groupingKeyType) static <T extends ScanTask>
CloseableIterable<ScanTaskGroup<T>> planTaskGroups
(CloseableIterable<T> tasks, long splitSize, int lookback, long openFileCost) static CloseableIterable
<CombinedScanTask> planTasks
(CloseableIterable<FileScanTask> splitFiles, long splitSize, int lookback, long openFileCost) static CloseableIterable
<FileScanTask> splitFiles
(CloseableIterable<FileScanTask> tasks, long splitSize)
-
Method Details
-
hasDeletes
-
hasEqDeletes
This is temporarily introduced since we plan to support pos-delete vectorized read first, then get to the equality-delete support. We will remove this method once both are supported. -
hasDeletes
-
splitFiles
public static CloseableIterable<FileScanTask> splitFiles(CloseableIterable<FileScanTask> tasks, long splitSize) -
planTasks
public static CloseableIterable<CombinedScanTask> planTasks(CloseableIterable<FileScanTask> splitFiles, long splitSize, int lookback, long openFileCost) -
planTaskGroups
public static <T extends ScanTask> List<ScanTaskGroup<T>> planTaskGroups(List<T> tasks, long splitSize, int lookback, long openFileCost) -
planTaskGroups
public static <T extends ScanTask> CloseableIterable<ScanTaskGroup<T>> planTaskGroups(CloseableIterable<T> tasks, long splitSize, int lookback, long openFileCost) -
planTaskGroups
public static <T extends PartitionScanTask> List<ScanTaskGroup<T>> planTaskGroups(List<T> tasks, long splitSize, int lookback, long openFileCost, Types.StructType groupingKeyType) -
mergeTasks
-
adjustSplitSize
public static long adjustSplitSize(long scanSize, int parallelism, long splitSize)
-