Package org.apache.iceberg.spark.source
Class SerializableTableWithSize
- java.lang.Object
-
- org.apache.iceberg.SerializableTable
-
- org.apache.iceberg.spark.source.SerializableTableWithSize
-
- All Implemented Interfaces:
java.io.Serializable
,Table
,org.apache.spark.util.KnownSizeEstimation
public class SerializableTableWithSize extends SerializableTable implements org.apache.spark.util.KnownSizeEstimation
This class provides a serializable table with a known size estimate. Spark calls its SizeEstimator class when broadcasting variables and this can be an expensive operation, so providing a known size estimate allows that operation to be skipped.- See Also:
- Serialized Form
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static class
SerializableTableWithSize.SerializableMetadataTableWithSize
-
Nested classes/interfaces inherited from class org.apache.iceberg.SerializableTable
SerializableTable.SerializableMetadataTable
-
-
Constructor Summary
Constructors Modifier Constructor Description protected
SerializableTableWithSize(Table table)
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description static Table
copyOf(Table table)
long
estimatedSize()
-
Methods inherited from class org.apache.iceberg.SerializableTable
currentSnapshot, encryption, expireSnapshots, history, io, location, locationProvider, manageSnapshots, name, newAppend, newBatchScan, newDelete, newOverwrite, newReplacePartitions, newRewrite, newRowDelta, newScan, newTable, newTransaction, properties, refresh, refs, replaceSortOrder, rewriteManifests, schema, schemas, snapshot, snapshots, sortOrder, sortOrders, spec, specs, statisticsFiles, updateLocation, updateProperties, updateSchema, updateSpec, updateStatistics
-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
Methods inherited from interface org.apache.iceberg.Table
newFastAppend, newIncrementalAppendScan, newIncrementalChangelogScan, snapshot
-
-