org.apache.iceberg.mr.mapreduce

Class IcebergInputFormat.ConfigBuilder

java.lang.Object

org.apache.iceberg.mr.mapreduce.IcebergInputFormat.ConfigBuilder

Enclosing class:

IcebergInputFormat<T>

public static class IcebergInputFormat.ConfigBuilder
extends java.lang.Object

Constructor Summary

Constructors

Constructor and Description
ConfigBuilder(org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method and Description
IcebergInputFormat.ConfigBuilder	asOfTime(long asOfTime)
IcebergInputFormat.ConfigBuilder	caseSensitive(boolean caseSensitive)
IcebergInputFormat.ConfigBuilder	catalogFunc(java.lang.Class<? extends java.util.function.Function<org.apache.hadoop.conf.Configuration,Catalog>> catalogFuncClass)
IcebergInputFormat.ConfigBuilder	filter(Expression expression)
IcebergInputFormat.ConfigBuilder	preferLocality() If this API is called.
IcebergInputFormat.ConfigBuilder	project(Schema schema)
IcebergInputFormat.ConfigBuilder	readFrom(java.lang.String path)
IcebergInputFormat.ConfigBuilder	reuseContainers(boolean reuse)
IcebergInputFormat.ConfigBuilder	skipResidualFiltering() Compute platforms pass down filters to data sources.
IcebergInputFormat.ConfigBuilder	snapshotId(long snapshotId)
IcebergInputFormat.ConfigBuilder	splitSize(long splitSize)
IcebergInputFormat.ConfigBuilder	useHiveRows()
IcebergInputFormat.ConfigBuilder	usePigTuples()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ConfigBuilder

public ConfigBuilder(org.apache.hadoop.conf.Configuration conf)

Method Detail

readFrom

public IcebergInputFormat.ConfigBuilder readFrom(java.lang.String path)

filter

public IcebergInputFormat.ConfigBuilder filter(Expression expression)

project

public IcebergInputFormat.ConfigBuilder project(Schema schema)

reuseContainers

public IcebergInputFormat.ConfigBuilder reuseContainers(boolean reuse)

caseSensitive

public IcebergInputFormat.ConfigBuilder caseSensitive(boolean caseSensitive)

snapshotId

public IcebergInputFormat.ConfigBuilder snapshotId(long snapshotId)

asOfTime

public IcebergInputFormat.ConfigBuilder asOfTime(long asOfTime)

splitSize

public IcebergInputFormat.ConfigBuilder splitSize(long splitSize)

preferLocality

public IcebergInputFormat.ConfigBuilder preferLocality()

If this API is called. The input splits constructed will have host location information

catalogFunc

public IcebergInputFormat.ConfigBuilder catalogFunc(java.lang.Class<? extends java.util.function.Function<org.apache.hadoop.conf.Configuration,Catalog>> catalogFuncClass)

useHiveRows

public IcebergInputFormat.ConfigBuilder useHiveRows()

usePigTuples

public IcebergInputFormat.ConfigBuilder usePigTuples()

skipResidualFiltering

public IcebergInputFormat.ConfigBuilder skipResidualFiltering()

Compute platforms pass down filters to data sources. If the data source cannot apply some filters, or only partially applies the filter, it will return the residual filter back. If the platform can correctly apply the residual filters, then it should call this api. Otherwise the current api will throw an exception if the passed in filter is not completely satisfied.