org.apache.iceberg.spark.source

Class CustomCatalogs

java.lang.Object

org.apache.iceberg.spark.source.CustomCatalogs

public final class CustomCatalogs
extends java.lang.Object

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	ICEBERG_CATALOG_PREFIX
static java.lang.String	ICEBERG_DEFAULT_CATALOG

Method Summary

Modifier and Type	Method and Description
static Catalog	loadCatalog(org.apache.spark.sql.SparkSession spark, java.lang.String name) Build an Iceberg Catalog to be used by this Spark source adapter.
static Table	table(org.apache.spark.sql.SparkSession spark, java.lang.String path)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

ICEBERG_DEFAULT_CATALOG

public static final java.lang.String ICEBERG_DEFAULT_CATALOG

See Also:

Constant Field Values

ICEBERG_CATALOG_PREFIX

public static final java.lang.String ICEBERG_CATALOG_PREFIX

See Also:

Constant Field Values

Method Detail

loadCatalog

public static Catalog loadCatalog(org.apache.spark.sql.SparkSession spark,
                                  java.lang.String name)

Build an Iceberg Catalog to be used by this Spark source adapter.

The cache is to facilitate reuse of catalogs, especially if wrapped in CachingCatalog. For non-Hive catalogs all custom parameters passed to the catalog are considered in the cache key. Hive catalogs only cache based on the Metastore URIs as per previous behaviour.

Parameters:

spark - Spark Session

name - Catalog Name

Returns:

an Iceberg catalog

table

public static Table table(org.apache.spark.sql.SparkSession spark,
                          java.lang.String path)