Package org.apache.iceberg.mr

Class InputFormatConfig.ConfigBuilder

java.lang.Object

org.apache.iceberg.mr.InputFormatConfig.ConfigBuilder

Enclosing class:

InputFormatConfig

public static class InputFormatConfig.ConfigBuilder
extends Object

Constructor Summary

Constructors

Constructor	Description
ConfigBuilder(org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method	Description
InputFormatConfig.ConfigBuilder	asOfTime(long asOfTime)
InputFormatConfig.ConfigBuilder	caseSensitive(boolean caseSensitive)
org.apache.hadoop.conf.Configuration	conf()
InputFormatConfig.ConfigBuilder	filter(Expression expression)
InputFormatConfig.ConfigBuilder	preferLocality()	If this API is called.
InputFormatConfig.ConfigBuilder	project(Schema schema)
InputFormatConfig.ConfigBuilder	readFrom(String location)
InputFormatConfig.ConfigBuilder	readFrom(TableIdentifier identifier)
InputFormatConfig.ConfigBuilder	reuseContainers(boolean reuse)
InputFormatConfig.ConfigBuilder	schema(Schema schema)
InputFormatConfig.ConfigBuilder	select(String... columns)
InputFormatConfig.ConfigBuilder	select(List<String> columns)
InputFormatConfig.ConfigBuilder	skipResidualFiltering()	Compute platforms pass down filters to data sources.
InputFormatConfig.ConfigBuilder	snapshotId(long snapshotId)
InputFormatConfig.ConfigBuilder	splitSize(long splitSize)
InputFormatConfig.ConfigBuilder	useHiveRows()
InputFormatConfig.ConfigBuilder	usePigTuples()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

ConfigBuilder

public ConfigBuilder(org.apache.hadoop.conf.Configuration conf)

Method Details

conf

public org.apache.hadoop.conf.Configuration conf()

filter

public InputFormatConfig.ConfigBuilder filter(Expression expression)

project

public InputFormatConfig.ConfigBuilder project(Schema schema)

schema

public InputFormatConfig.ConfigBuilder schema(Schema schema)

select

public InputFormatConfig.ConfigBuilder select(List<String> columns)

select

public InputFormatConfig.ConfigBuilder select(String... columns)

readFrom

public InputFormatConfig.ConfigBuilder readFrom(TableIdentifier identifier)

readFrom

public InputFormatConfig.ConfigBuilder readFrom(String location)

reuseContainers

public InputFormatConfig.ConfigBuilder reuseContainers(boolean reuse)

caseSensitive

public InputFormatConfig.ConfigBuilder caseSensitive(boolean caseSensitive)

snapshotId

public InputFormatConfig.ConfigBuilder snapshotId(long snapshotId)

asOfTime

public InputFormatConfig.ConfigBuilder asOfTime(long asOfTime)

splitSize

public InputFormatConfig.ConfigBuilder splitSize(long splitSize)

preferLocality

public InputFormatConfig.ConfigBuilder preferLocality()

If this API is called. The input splits constructed will have host location information

useHiveRows

public InputFormatConfig.ConfigBuilder useHiveRows()

usePigTuples

public InputFormatConfig.ConfigBuilder usePigTuples()

skipResidualFiltering

public InputFormatConfig.ConfigBuilder skipResidualFiltering()

Compute platforms pass down filters to data sources. If the data source cannot apply some filters, or only partially applies the filter, it will return the residual filter back. If the platform can correctly apply the residual filters, then it should call this api. Otherwise the current api will throw an exception if the passed in filter is not completely satisfied.