Package org.apache.iceberg.mr.mapred
Class MapredIcebergInputFormat<T>
- java.lang.Object
-
- org.apache.iceberg.mr.mapred.MapredIcebergInputFormat<T>
-
- Type Parameters:
T
- Java class of records constructed by Iceberg; default isRecord
- All Implemented Interfaces:
org.apache.hadoop.mapred.InputFormat<java.lang.Void,Container<T>>
- Direct Known Subclasses:
HiveIcebergInputFormat
public class MapredIcebergInputFormat<T> extends java.lang.Object implements org.apache.hadoop.mapred.InputFormat<java.lang.Void,Container<T>>
Generic MR v1 InputFormat API for Iceberg.
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static class
MapredIcebergInputFormat.CompatibilityTaskAttemptContextImpl
-
Constructor Summary
Constructors Constructor Description MapredIcebergInputFormat()
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description static InputFormatConfig.ConfigBuilder
configure(org.apache.hadoop.mapred.JobConf job)
Configures theJobConf
to use theMapredIcebergInputFormat
and returns a helper to add further configuration.org.apache.hadoop.mapred.RecordReader<java.lang.Void,Container<T>>
getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter)
org.apache.hadoop.mapred.InputSplit[]
getSplits(org.apache.hadoop.mapred.JobConf job, int numSplits)
static org.apache.hadoop.mapreduce.TaskAttemptContext
newTaskAttemptContext(org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter)
-
-
-
Method Detail
-
configure
public static InputFormatConfig.ConfigBuilder configure(org.apache.hadoop.mapred.JobConf job)
Configures theJobConf
to use theMapredIcebergInputFormat
and returns a helper to add further configuration.- Parameters:
job
- theJobConf
to configure
-
getSplits
public org.apache.hadoop.mapred.InputSplit[] getSplits(org.apache.hadoop.mapred.JobConf job, int numSplits) throws java.io.IOException
-
getRecordReader
public org.apache.hadoop.mapred.RecordReader<java.lang.Void,Container<T>> getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter) throws java.io.IOException
-
newTaskAttemptContext
public static org.apache.hadoop.mapreduce.TaskAttemptContext newTaskAttemptContext(org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter)
-
-