org.apache.iceberg.hadoop

Class HadoopTables

java.lang.Object

org.apache.iceberg.hadoop.HadoopTables

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, Tables

public class HadoopTables
extends java.lang.Object
implements Tables, org.apache.hadoop.conf.Configurable

Implementation of Iceberg tables that uses the Hadoop FileSystem to store metadata and manifests.

Constructor Summary

Constructors

Constructor and Description
HadoopTables()
HadoopTables(org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method and Description
Table	create(Schema schema, PartitionSpec spec, java.util.Map<java.lang.String,java.lang.String> properties, java.lang.String location) Create a table using the FileSystem implementation resolve from location.
org.apache.hadoop.conf.Configuration	getConf()
Table	load(java.lang.String location) Loads the table location from a FileSystem path location.
void	setConf(org.apache.hadoop.conf.Configuration conf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.iceberg.Tables

create, create

Constructor Detail

HadoopTables

public HadoopTables()

HadoopTables

public HadoopTables(org.apache.hadoop.conf.Configuration conf)

Method Detail

load

public Table load(java.lang.String location)

Loads the table location from a FileSystem path location.

Specified by:

load in interface Tables

Parameters:

location - a path URI (e.g. hdfs:///warehouse/my_table/)

Returns:

table implementation

create

public Table create(Schema schema,
                    PartitionSpec spec,
                    java.util.Map<java.lang.String,java.lang.String> properties,
                    java.lang.String location)

Create a table using the FileSystem implementation resolve from location.

Specified by:

create in interface Tables

Parameters:

schema - iceberg schema used to create the table

spec - partitioning spec, if null the table will be unpartitioned

properties - a string map of table properties, initialized to empty if null

location - a path URI (e.g. hdfs:///warehouse/my_table)

Returns:

newly created table implementation

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable