Package org.apache.iceberg.spark.source

Class IcebergSource

  • All Implemented Interfaces:
    org.apache.spark.sql.connector.catalog.TableProvider, org.apache.spark.sql.sources.DataSourceRegister
    public class IcebergSource
extends java.lang.Object
implements org.apache.spark.sql.sources.DataSourceRegister, org.apache.spark.sql.connector.catalog.TableProvider

    • Constructor Summary

      Constructors 
      Constructor Description
      IcebergSource()  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      protected Table findTable​(java.util.Map<java.lang.String,​java.lang.String> options, org.apache.hadoop.conf.Configuration conf)  
      SparkTable getTable​(org.apache.spark.sql.types.StructType schema, org.apache.spark.sql.connector.expressions.Transform[] partitioning, java.util.Map<java.lang.String,​java.lang.String> options)  
      org.apache.spark.sql.connector.expressions.Transform[] inferPartitioning​(org.apache.spark.sql.util.CaseInsensitiveStringMap options)  
      org.apache.spark.sql.types.StructType inferSchema​(org.apache.spark.sql.util.CaseInsensitiveStringMap options)  
      java.lang.String shortName()  
      boolean supportsExternalMetadata()  

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • IcebergSource

        public IcebergSource()

    • Method Detail

      • shortName

        public java.lang.String shortName()
        Specified by:
        shortName in interface org.apache.spark.sql.sources.DataSourceRegister

      • inferSchema

        public org.apache.spark.sql.types.StructType inferSchema​(org.apache.spark.sql.util.CaseInsensitiveStringMap options)
        Specified by:
        inferSchema in interface org.apache.spark.sql.connector.catalog.TableProvider

      • inferPartitioning

        public org.apache.spark.sql.connector.expressions.Transform[] inferPartitioning​(org.apache.spark.sql.util.CaseInsensitiveStringMap options)
        Specified by:
        inferPartitioning in interface org.apache.spark.sql.connector.catalog.TableProvider

      • supportsExternalMetadata

        public boolean supportsExternalMetadata()
        Specified by:
        supportsExternalMetadata in interface org.apache.spark.sql.connector.catalog.TableProvider

      • getTable

        public SparkTable getTable​(org.apache.spark.sql.types.StructType schema,
                           org.apache.spark.sql.connector.expressions.Transform[] partitioning,
                           java.util.Map<java.lang.String,​java.lang.String> options)
        Specified by:
        getTable in interface org.apache.spark.sql.connector.catalog.TableProvider

      • findTable

        protected Table findTable​(java.util.Map<java.lang.String,​java.lang.String> options,
                          org.apache.hadoop.conf.Configuration conf)