Package org.apache.iceberg.hadoop

Class HadoopTables

  • All Implemented Interfaces:
    org.apache.hadoop.conf.Configurable, Tables
    public class HadoopTables
extends java.lang.Object
implements Tables, org.apache.hadoop.conf.Configurable
    Implementation of Iceberg tables that uses the Hadoop FileSystem to store metadata and manifests.

    • Constructor Summary

      Constructors 
      Constructor Description
      HadoopTables()  
      HadoopTables​(org.apache.hadoop.conf.Configuration conf)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      Table create​(Schema schema, PartitionSpec spec, java.util.Map<java.lang.String,​java.lang.String> properties, java.lang.String location)
      Create a table using the FileSystem implementation resolve from location.
      org.apache.hadoop.conf.Configuration getConf()  
      Table load​(java.lang.String location)
      Loads the table location from a FileSystem path location.
      void setConf​(org.apache.hadoop.conf.Configuration conf)  

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • HadoopTables

        public HadoopTables()

      • HadoopTables

        public HadoopTables​(org.apache.hadoop.conf.Configuration conf)

    • Method Detail

      • load

        public Table load​(java.lang.String location)
        Loads the table location from a FileSystem path location.
        Specified by:
        load in interface Tables
        Parameters:
        location - a path URI (e.g. hdfs:///warehouse/my_table/)
        Returns:
        table implementation

      • create

        public Table create​(Schema schema,
                    PartitionSpec spec,
                    java.util.Map<java.lang.String,​java.lang.String> properties,
                    java.lang.String location)
        Create a table using the FileSystem implementation resolve from location.
        Specified by:
        create in interface Tables
        Parameters:
        schema - iceberg schema used to create the table
        spec - partitioning spec, if null the table will be unpartitioned
        properties - a string map of table properties, initialized to empty if null
        location - a path URI (e.g. hdfs:///warehouse/my_table)
        Returns:
        newly created table implementation

      • setConf

        public void setConf​(org.apache.hadoop.conf.Configuration conf)
        Specified by:
        setConf in interface org.apache.hadoop.conf.Configurable

      • getConf

        public org.apache.hadoop.conf.Configuration getConf()
        Specified by:
        getConf in interface org.apache.hadoop.conf.Configurable