Package org.apache.iceberg

Class BaseMetadataTable

java.lang.Object

org.apache.iceberg.BaseMetadataTable

All Implemented Interfaces:

Serializable, Table

Direct Known Subclasses:

AllDataFilesTable, AllDeleteFilesTable, AllEntriesTable, AllFilesTable, AllManifestsTable, DataFilesTable, DeleteFilesTable, FilesTable, HistoryTable, ManifestEntriesTable, ManifestsTable, MetadataLogEntriesTable, PartitionsTable, PositionDeletesTable, RefsTable, SnapshotsTable

public abstract class BaseMetadataTable
extends Object
implements Serializable

Base class for metadata tables.

Serializing and deserializing a metadata table object returns a read only implementation of the metadata table using a StaticTableOperations. This way no Catalog related calls are needed when reading the table data after deserialization.

See Also:

• Serialized Form

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	BaseMetadataTable(Table table, String name)

Method Summary

Modifier and Type	Method	Description
Snapshot	currentSnapshot()	Get the current snapshot for this table, or null if there are no snapshots.
EncryptionManager	encryption()	Returns an EncryptionManager to encrypt and decrypt data files.
ExpireSnapshots	expireSnapshots()	Create a new expire API to manage snapshots in this table and commit.
List<HistoryEntry>	history()	Get the snapshot history of this table.
FileIO	io()	Returns a FileIO to read and write table data and metadata files.
String	location()	Return the table's base location.
LocationProvider	locationProvider()	Returns a LocationProvider to provide locations for new data files.
ManageSnapshots	manageSnapshots()	Create a new manage snapshots API to manage snapshots in this table and commit.
String	name()	Return the full name for this table.
AppendFiles	newAppend()	Create a new append API to add files to this table and commit.
DeleteFiles	newDelete()	Create a new delete API to replace files in this table and commit.
OverwriteFiles	newOverwrite()	Create a new overwrite API to overwrite files by a filter expression.
ReplacePartitions	newReplacePartitions()	Not recommended: Create a new replace partitions API to dynamically overwrite partitions in the table with new data.
RewriteFiles	newRewrite()	Create a new rewrite API to replace files in this table and commit.
RowDelta	newRowDelta()	Create a new row-level delta API to remove or replace rows in existing data files.
Transaction	newTransaction()	Create a new transaction API to commit multiple table operations at once.
List<PartitionStatisticsFile>	partitionStatisticsFiles()	Returns the current partition statistics files for the table.
Map<String,String>	properties()	Return a map of string properties for this table.
void	refresh()	Refresh the current table metadata.
Map<String,SnapshotRef>	refs()	Returns the current refs for the table
ReplaceSortOrder	replaceSortOrder()	Create a new ReplaceSortOrder to set the table sort order and commit the change.
RewriteManifests	rewriteManifests()	Create a new rewrite manifests API to replace manifests for this table and commit.
Map<Integer,Schema>	schemas()	Return a map of schema for this table.
Snapshot	snapshot(long snapshotId)	Get the snapshot of this table with the given id, or null if there is no matching snapshot.
Iterable<Snapshot>	snapshots()	Get the snapshots of this table.
SortOrder	sortOrder()	Return the sort order for this table.
Map<Integer,SortOrder>	sortOrders()	Return a map of sort order IDs to sort orders for this table.
PartitionSpec	spec()	Return the partition spec for this table.
Map<Integer,PartitionSpec>	specs()	Return a map of partition specs for this table.
List<StatisticsFile>	statisticsFiles()	Returns the current statistics files for the table
BaseTable	table()
String	toString()
UpdateLocation	updateLocation()	Create a new UpdateLocation to update table location and commit the changes.
UpdatePartitionStatistics	updatePartitionStatistics()	Create a new update partition statistics API to add or remove partition statistics files in this table.
UpdateProperties	updateProperties()	Create a new UpdateProperties to update table properties and commit the changes.
UpdateSchema	updateSchema()	Create a new UpdateSchema to alter the columns of this table and commit the change.
UpdatePartitionSpec	updateSpec()	Create a new UpdatePartitionSpec to alter the partition spec of this table and commit the change.
UpdateStatistics	updateStatistics()	Create a new update table statistics API to add or remove statistics files in this table.
UUID	uuid()	Returns the UUID of the table

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.iceberg.Table

newBatchScan, newFastAppend, newIncrementalAppendScan, newIncrementalChangelogScan, newScan, schema, snapshot

Constructor Details

BaseMetadataTable

protected BaseMetadataTable(Table table,
 String name)

Method Details

table

public BaseTable table()

name

public String name()

Description copied from interface: Table

Return the full name for this table.

Specified by:

name in interface Table

Returns:

this table's name

io

public FileIO io()

Description copied from interface: Table

Returns a FileIO to read and write table data and metadata files.

Specified by:

io in interface Table

location

public String location()

Description copied from interface: Table

Return the table's base location.

Specified by:

location in interface Table

Returns:

this table's location

encryption

public EncryptionManager encryption()

Description copied from interface: Table

Returns an EncryptionManager to encrypt and decrypt data files.

Specified by:

encryption in interface Table

locationProvider

public LocationProvider locationProvider()

Description copied from interface: Table

Returns a LocationProvider to provide locations for new data files.

Specified by:

locationProvider in interface Table

refresh

public void refresh()

Description copied from interface: Table

Refresh the current table metadata.

Specified by:

refresh in interface Table

schemas

public Map<Integer,Schema> schemas()

Description copied from interface: Table

Return a map of schema for this table.

Specified by:

schemas in interface Table

Returns:

this table's schema map

spec

public PartitionSpec spec()

Description copied from interface: Table

Return the partition spec for this table.

Specified by:

spec in interface Table

Returns:

this table's partition spec

specs

public Map<Integer,PartitionSpec> specs()

Description copied from interface: Table

Return a map of partition specs for this table.

Specified by:

specs in interface Table

Returns:

this table's partition specs map

sortOrder

public SortOrder sortOrder()

Description copied from interface: Table

Return the sort order for this table.

Specified by:

sortOrder in interface Table

Returns:

this table's sort order

sortOrders

public Map<Integer,SortOrder> sortOrders()

Description copied from interface: Table

Return a map of sort order IDs to sort orders for this table.

Specified by:

sortOrders in interface Table

Returns:

this table's sort orders map

properties

public Map<String,String> properties()

Description copied from interface: Table

Return a map of string properties for this table.

Specified by:

properties in interface Table

Returns:

this table's properties map

currentSnapshot

public Snapshot currentSnapshot()

Description copied from interface: Table

Get the current snapshot for this table, or null if there are no snapshots.

Specified by:

currentSnapshot in interface Table

Returns:

the current table Snapshot.

snapshots

public Iterable<Snapshot> snapshots()

Description copied from interface: Table

Get the snapshots of this table.

Specified by:

snapshots in interface Table

Returns:

an Iterable of snapshots of this table.

snapshot

public Snapshot snapshot(long snapshotId)

Description copied from interface: Table

Get the snapshot of this table with the given id, or null if there is no matching snapshot.

Specified by:

snapshot in interface Table

Returns:

the Snapshot with the given id.

history

public List<HistoryEntry> history()

Description copied from interface: Table

Get the snapshot history of this table.

Specified by:

history in interface Table

Returns:

a list of history entries

statisticsFiles

public List<StatisticsFile> statisticsFiles()

Description copied from interface: Table

Returns the current statistics files for the table

Specified by:

statisticsFiles in interface Table

Returns:

the current statistics files for the table

partitionStatisticsFiles

public List<PartitionStatisticsFile> partitionStatisticsFiles()

Description copied from interface: Table

Returns the current partition statistics files for the table.

Specified by:

partitionStatisticsFiles in interface Table

refs

public Map<String,SnapshotRef> refs()

Description copied from interface: Table

Returns the current refs for the table

Specified by:

refs in interface Table

Returns:

the current refs for the table

uuid

public UUID uuid()

Description copied from interface: Table

Returns the UUID of the table

Specified by:

uuid in interface Table

Returns:

the UUID of the table

toString

public String toString()

Overrides:

toString in class Object

updateSchema

public UpdateSchema updateSchema()

Description copied from interface: Table

Create a new UpdateSchema to alter the columns of this table and commit the change.

Specified by:

updateSchema in interface Table

Returns:

a new UpdateSchema

updateSpec

public UpdatePartitionSpec updateSpec()

Description copied from interface: Table

Create a new UpdatePartitionSpec to alter the partition spec of this table and commit the change.

Specified by:

updateSpec in interface Table

Returns:

a new UpdatePartitionSpec

updateProperties

public UpdateProperties updateProperties()

Description copied from interface: Table

Create a new UpdateProperties to update table properties and commit the changes.

Specified by:

updateProperties in interface Table

Returns:

a new UpdateProperties

replaceSortOrder

public ReplaceSortOrder replaceSortOrder()

Description copied from interface: Table

Create a new ReplaceSortOrder to set the table sort order and commit the change.

Specified by:

replaceSortOrder in interface Table

Returns:

a new ReplaceSortOrder

updateLocation

public UpdateLocation updateLocation()

Description copied from interface: Table

Create a new UpdateLocation to update table location and commit the changes.

Specified by:

updateLocation in interface Table

Returns:

a new UpdateLocation

newAppend

public AppendFiles newAppend()

Description copied from interface: Table

Create a new append API to add files to this table and commit.

Specified by:

newAppend in interface Table

Returns:

a new AppendFiles

newRewrite

public RewriteFiles newRewrite()

Description copied from interface: Table

Create a new rewrite API to replace files in this table and commit.

Specified by:

newRewrite in interface Table

Returns:

a new RewriteFiles

rewriteManifests

public RewriteManifests rewriteManifests()

Description copied from interface: Table

Create a new rewrite manifests API to replace manifests for this table and commit.

Specified by:

rewriteManifests in interface Table

Returns:

a new RewriteManifests

newOverwrite

public OverwriteFiles newOverwrite()

Description copied from interface: Table

Create a new overwrite API to overwrite files by a filter expression.

Specified by:

newOverwrite in interface Table

Returns:

a new OverwriteFiles

newRowDelta

public RowDelta newRowDelta()

Description copied from interface: Table

Create a new row-level delta API to remove or replace rows in existing data files.

Specified by:

newRowDelta in interface Table

Returns:

a new RowDelta

newReplacePartitions

public ReplacePartitions newReplacePartitions()

Description copied from interface: Table

Not recommended: Create a new replace partitions API to dynamically overwrite partitions in the table with new data.

This is provided to implement SQL compatible with Hive table operations but is not recommended. Instead, use the overwrite API to explicitly overwrite data.

Specified by:

newReplacePartitions in interface Table

Returns:

a new ReplacePartitions

newDelete

public DeleteFiles newDelete()

Description copied from interface: Table

Create a new delete API to replace files in this table and commit.

Specified by:

newDelete in interface Table

Returns:

a new DeleteFiles

updateStatistics

public UpdateStatistics updateStatistics()

Description copied from interface: Table

Create a new update table statistics API to add or remove statistics files in this table.

Specified by:

updateStatistics in interface Table

Returns:

a new UpdateStatistics

updatePartitionStatistics

public UpdatePartitionStatistics updatePartitionStatistics()

Description copied from interface: Table

Create a new update partition statistics API to add or remove partition statistics files in this table.

Specified by:

updatePartitionStatistics in interface Table

Returns:

a new UpdatePartitionStatistics

expireSnapshots

public ExpireSnapshots expireSnapshots()

Description copied from interface: Table

Create a new expire API to manage snapshots in this table and commit.

Specified by:

expireSnapshots in interface Table

Returns:

a new ExpireSnapshots

manageSnapshots

public ManageSnapshots manageSnapshots()

Description copied from interface: Table

Create a new manage snapshots API to manage snapshots in this table and commit.

Specified by:

manageSnapshots in interface Table

Returns:

a new ManageSnapshots

newTransaction

public Transaction newTransaction()

Description copied from interface: Table

Create a new transaction API to commit multiple table operations at once.

Specified by:

newTransaction in interface Table

Returns:

a new Transaction