Package org.apache.iceberg.rest

Class RESTSessionCatalog

java.lang.Object

org.apache.iceberg.catalog.BaseSessionCatalog

org.apache.iceberg.rest.RESTSessionCatalog

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, SessionCatalog, Configurable<java.lang.Object>

public class RESTSessionCatalog
extends BaseSessionCatalog
implements Configurable<java.lang.Object>, java.io.Closeable

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.iceberg.catalog.BaseSessionCatalog

BaseSessionCatalog.AsCatalog

Nested classes/interfaces inherited from interface org.apache.iceberg.catalog.SessionCatalog

SessionCatalog.SessionContext

Constructor Summary

Constructors

Constructor	Description
RESTSessionCatalog()
RESTSessionCatalog(java.util.function.Function<java.util.Map<java.lang.String,java.lang.String>,RESTClient> clientBuilder, java.util.function.BiFunction<SessionCatalog.SessionContext,java.util.Map<java.lang.String,java.lang.String>,FileIO> ioBuilder)

Method Summary

Modifier and Type	Method	Description
Catalog.TableBuilder	buildTable(SessionCatalog.SessionContext context, TableIdentifier identifier, Schema schema)	Create a builder to create a table or start a create/replace transaction.
void	close()
void	commitTransaction(SessionCatalog.SessionContext context, java.util.List<TableCommit> commits)
void	createNamespace(SessionCatalog.SessionContext context, Namespace namespace, java.util.Map<java.lang.String,java.lang.String> metadata)	Create a namespace in the catalog.
boolean	dropNamespace(SessionCatalog.SessionContext context, Namespace ns)	Drop a namespace.
boolean	dropTable(SessionCatalog.SessionContext context, TableIdentifier identifier)	Drop a table, without requesting that files are immediately deleted.
void	initialize(java.lang.String name, java.util.Map<java.lang.String,java.lang.String> unresolved)	Initialize given a custom name and a map of catalog properties.
void	invalidateTable(SessionCatalog.SessionContext context, TableIdentifier ident)	Invalidate cached table metadata from current catalog.
java.util.List<Namespace>	listNamespaces(SessionCatalog.SessionContext context, Namespace namespace)	List child namespaces from the namespace.
java.util.List<TableIdentifier>	listTables(SessionCatalog.SessionContext context, Namespace ns)	Return all the identifiers under this namespace.
java.util.Map<java.lang.String,java.lang.String>	loadNamespaceMetadata(SessionCatalog.SessionContext context, Namespace ns)	Load metadata properties for a namespace.
Table	loadTable(SessionCatalog.SessionContext context, TableIdentifier identifier)	Load a table.
boolean	purgeTable(SessionCatalog.SessionContext context, TableIdentifier identifier)	Drop a table and request that files are immediately deleted.
Table	registerTable(SessionCatalog.SessionContext context, TableIdentifier ident, java.lang.String metadataFileLocation)	Register a table if it does not exist.
void	renameTable(SessionCatalog.SessionContext context, TableIdentifier from, TableIdentifier to)	Rename a table.
void	setConf(java.lang.Object newConf)
boolean	updateNamespaceMetadata(SessionCatalog.SessionContext context, Namespace ns, java.util.Map<java.lang.String,java.lang.String> updates, java.util.Set<java.lang.String> removals)	Set a collection of properties on a namespace in the catalog.

Methods inherited from class org.apache.iceberg.catalog.BaseSessionCatalog

asCatalog, name, properties, withContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.iceberg.catalog.SessionCatalog

createNamespace, listNamespaces, namespaceExists, tableExists

Constructor Detail

RESTSessionCatalog

public RESTSessionCatalog()

RESTSessionCatalog

public RESTSessionCatalog(java.util.function.Function<java.util.Map<java.lang.String,java.lang.String>,RESTClient> clientBuilder,
                          java.util.function.BiFunction<SessionCatalog.SessionContext,java.util.Map<java.lang.String,java.lang.String>,FileIO> ioBuilder)

Method Detail

initialize

public void initialize(java.lang.String name,
                       java.util.Map<java.lang.String,java.lang.String> unresolved)

Description copied from interface: SessionCatalog

Initialize given a custom name and a map of catalog properties.

Specified by:

initialize in interface SessionCatalog

Overrides:

initialize in class BaseSessionCatalog

Parameters:

name - a custom name for the catalog

unresolved - catalog properties

setConf

public void setConf(java.lang.Object newConf)

Specified by:

setConf in interface Configurable<java.lang.Object>

listTables

public java.util.List<TableIdentifier> listTables(SessionCatalog.SessionContext context,
                                                  Namespace ns)

Description copied from interface: SessionCatalog

Return all the identifiers under this namespace.

Specified by:

listTables in interface SessionCatalog

Parameters:

context - session context

ns - a namespace

Returns:

a list of identifiers for tables

dropTable

public boolean dropTable(SessionCatalog.SessionContext context,
                         TableIdentifier identifier)

Description copied from interface: SessionCatalog

Drop a table, without requesting that files are immediately deleted.

Data and metadata files should be deleted according to the catalog's policy.

Specified by:

dropTable in interface SessionCatalog

Parameters:

context - session context

identifier - a table identifier

Returns:

true if the table was dropped, false if the table did not exist

purgeTable

public boolean purgeTable(SessionCatalog.SessionContext context,
                          TableIdentifier identifier)

Description copied from interface: SessionCatalog

Drop a table and request that files are immediately deleted.

Specified by:

purgeTable in interface SessionCatalog

Parameters:

context - session context

identifier - a table identifier

Returns:

true if the table was dropped and purged, false if the table did not exist

renameTable

public void renameTable(SessionCatalog.SessionContext context,
                        TableIdentifier from,
                        TableIdentifier to)

Description copied from interface: SessionCatalog

Rename a table.

Specified by:

renameTable in interface SessionCatalog

Parameters:

context - session context

from - identifier of the table to rename

to - new table name

loadTable

public Table loadTable(SessionCatalog.SessionContext context,
                       TableIdentifier identifier)

Description copied from interface: SessionCatalog

Load a table.

Specified by:

loadTable in interface SessionCatalog

Parameters:

context - session context

identifier - a table identifier

Returns:

instance of Table implementation referred by tableIdentifier

buildTable

public Catalog.TableBuilder buildTable(SessionCatalog.SessionContext context,
                                       TableIdentifier identifier,
                                       Schema schema)

Description copied from interface: SessionCatalog

Create a builder to create a table or start a create/replace transaction.

Specified by:

buildTable in interface SessionCatalog

Parameters:

context - session context

identifier - a table identifier

schema - a schema

Returns:

the builder to create a table or start a create/replace transaction

invalidateTable

public void invalidateTable(SessionCatalog.SessionContext context,
                            TableIdentifier ident)

Description copied from interface: SessionCatalog

Invalidate cached table metadata from current catalog.

If the table is already loaded or cached, drop cached data. If the table does not exist or is not cached, do nothing.

Specified by:

invalidateTable in interface SessionCatalog

Parameters:

context - session context

ident - a table identifier

registerTable

public Table registerTable(SessionCatalog.SessionContext context,
                           TableIdentifier ident,
                           java.lang.String metadataFileLocation)

Description copied from interface: SessionCatalog

Register a table if it does not exist.

Specified by:

registerTable in interface SessionCatalog

Parameters:

context - session context

ident - a table identifier

metadataFileLocation - the location of a metadata file

Returns:

a Table instance

createNamespace

public void createNamespace(SessionCatalog.SessionContext context,
                            Namespace namespace,
                            java.util.Map<java.lang.String,java.lang.String> metadata)

Description copied from interface: SessionCatalog

Create a namespace in the catalog.

Specified by:

createNamespace in interface SessionCatalog

Parameters:

context - session context

namespace - a namespace

metadata - a string Map of properties for the given namespace

listNamespaces

public java.util.List<Namespace> listNamespaces(SessionCatalog.SessionContext context,
                                                Namespace namespace)

Description copied from interface: SessionCatalog

List child namespaces from the namespace.

For two existing tables named 'a.b.c.table' and 'a.b.d.table', this method returns:

• Given: Namespace.empty()
• Returns: Namespace.of("a")

• Given: Namespace.of("a")
• Returns: Namespace.of("a", "b")

• Given: Namespace.of("a", "b")
• Returns: Namespace.of("a", "b", "c") and Namespace.of("a", "b", "d")

• Given: Namespace.of("a", "b", "c")
• Returns: empty list, because there are no child namespaces

Specified by:

listNamespaces in interface SessionCatalog

Parameters:

context - session context

namespace - a namespace

Returns:

a List of child Namespace names from the given namespace

loadNamespaceMetadata

public java.util.Map<java.lang.String,java.lang.String> loadNamespaceMetadata(SessionCatalog.SessionContext context,
                                                                                    Namespace ns)

Description copied from interface: SessionCatalog

Load metadata properties for a namespace.

Specified by:

loadNamespaceMetadata in interface SessionCatalog

Parameters:

context - session context

ns - a namespace

Returns:

a string map of properties for the given namespace

dropNamespace

public boolean dropNamespace(SessionCatalog.SessionContext context,
                             Namespace ns)

Description copied from interface: SessionCatalog

Drop a namespace. If the namespace exists and was dropped, this will return true.

Specified by:

dropNamespace in interface SessionCatalog

Parameters:

context - session context

ns - a namespace

Returns:

true if the namespace was dropped, false otherwise.

updateNamespaceMetadata

public boolean updateNamespaceMetadata(SessionCatalog.SessionContext context,
                                       Namespace ns,
                                       java.util.Map<java.lang.String,java.lang.String> updates,
                                       java.util.Set<java.lang.String> removals)

Description copied from interface: SessionCatalog

Set a collection of properties on a namespace in the catalog.

Properties that are not in the given map are not modified or removed by this method.

Specified by:

updateNamespaceMetadata in interface SessionCatalog

Parameters:

context - session context

ns - a namespace

updates - properties to set for the namespace

removals - properties to remove from the namespace

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface java.io.Closeable

Throws:

java.io.IOException

commitTransaction

public void commitTransaction(SessionCatalog.SessionContext context,
                              java.util.List<TableCommit> commits)