org.apache.iceberg.mr.hive

Class HiveIcebergInputFormat

java.lang.Object

org.apache.iceberg.mr.mapred.MapredIcebergInputFormat<Record>

org.apache.iceberg.mr.hive.HiveIcebergInputFormat

All Implemented Interfaces:

org.apache.hadoop.hive.ql.exec.vector.VectorizedInputFormatInterface, org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.AvoidSplitCombination, org.apache.hadoop.mapred.InputFormat<java.lang.Void,Container<Record>>

public class HiveIcebergInputFormat
extends MapredIcebergInputFormat<Record>
implements org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.AvoidSplitCombination, org.apache.hadoop.hive.ql.exec.vector.VectorizedInputFormatInterface

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.iceberg.mr.mapred.MapredIcebergInputFormat

MapredIcebergInputFormat.CompatibilityTaskAttemptContextImpl

Constructor Summary

Constructors

Constructor and Description
HiveIcebergInputFormat()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.mapred.RecordReader<java.lang.Void,Container<Record>>	getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter)
org.apache.hadoop.mapred.InputSplit[]	getSplits(org.apache.hadoop.mapred.JobConf job, int numSplits)
VectorizedSupport.Support[]	getSupportedFeatures()
boolean	shouldSkipCombine(org.apache.hadoop.fs.Path path, org.apache.hadoop.conf.Configuration conf)

Methods inherited from class org.apache.iceberg.mr.mapred.MapredIcebergInputFormat

configure, newTaskAttemptContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HiveIcebergInputFormat

public HiveIcebergInputFormat()

Method Detail

getSplits

public org.apache.hadoop.mapred.InputSplit[] getSplits(org.apache.hadoop.mapred.JobConf job,
                                                       int numSplits)
                                                throws java.io.IOException

Specified by:

getSplits in interface org.apache.hadoop.mapred.InputFormat<java.lang.Void,Container<Record>>

Overrides:

getSplits in class MapredIcebergInputFormat<Record>

Throws:

java.io.IOException

getRecordReader

public org.apache.hadoop.mapred.RecordReader<java.lang.Void,Container<Record>> getRecordReader(org.apache.hadoop.mapred.InputSplit split,
                                                                                               org.apache.hadoop.mapred.JobConf job,
                                                                                               org.apache.hadoop.mapred.Reporter reporter)
                                                                                        throws java.io.IOException

Specified by:

getRecordReader in interface org.apache.hadoop.mapred.InputFormat<java.lang.Void,Container<Record>>

Overrides:

getRecordReader in class MapredIcebergInputFormat<Record>

Throws:

java.io.IOException

shouldSkipCombine

public boolean shouldSkipCombine(org.apache.hadoop.fs.Path path,
                                 org.apache.hadoop.conf.Configuration conf)

Specified by:

shouldSkipCombine in interface org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.AvoidSplitCombination

getSupportedFeatures

public VectorizedSupport.Support[] getSupportedFeatures()