Package org.apache.iceberg.types
Class TypeUtil
- java.lang.Object
-
- org.apache.iceberg.types.TypeUtil
-
public class TypeUtil extends java.lang.Object
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static class
TypeUtil.CustomOrderSchemaVisitor<T>
static interface
TypeUtil.NextID
Interface for passing a function that assigns column IDs.static class
TypeUtil.SchemaVisitor<T>
-
Method Summary
All Methods Static Methods Concrete Methods Modifier and Type Method Description static Schema
assignFreshIds(Schema schema, TypeUtil.NextID nextId)
Assigns fresh ids from thenextId function
for all fields in a schema.static Type
assignFreshIds(Type type, TypeUtil.NextID nextId)
Assigns fresh ids from thenextId function
for all fields in a type.static Schema
assignIncreasingFreshIds(Schema schema)
Assigns strictly increasing fresh ids for all fields in a schema, starting from 1.static int
decimalRequiredBytes(int precision)
static Type
find(Schema schema, java.util.function.Predicate<Type> predicate)
static java.util.Set<java.lang.Integer>
getProjectedIds(Schema schema)
static java.util.Set<java.lang.Integer>
getProjectedIds(Type type)
static java.util.Map<java.lang.Integer,Types.NestedField>
indexById(Types.StructType struct)
static java.util.Map<java.lang.String,java.lang.Integer>
indexByLowerCaseName(Types.StructType struct)
static java.util.Map<java.lang.String,java.lang.Integer>
indexByName(Types.StructType struct)
static java.util.Map<java.lang.Integer,java.lang.Integer>
indexParents(Types.StructType struct)
static boolean
isPromotionAllowed(Type from, Type.PrimitiveType to)
static Schema
join(Schema left, Schema right)
static Schema
reassignIds(Schema schema, Schema idSourceSchema)
Reassigns ids in a schema from another schema.static Schema
select(Schema schema, java.util.Set<java.lang.Integer> fieldIds)
static Types.StructType
select(Types.StructType struct, java.util.Set<java.lang.Integer> fieldIds)
static Schema
selectNot(Schema schema, java.util.Set<java.lang.Integer> fieldIds)
static Types.StructType
selectNot(Types.StructType struct, java.util.Set<java.lang.Integer> fieldIds)
static void
validateWriteSchema(Schema tableSchema, Schema writeSchema, java.lang.Boolean checkNullability, java.lang.Boolean checkOrdering)
Check whether we could write the iceberg table with the user-provided write schema.static <T> T
visit(Schema schema, TypeUtil.CustomOrderSchemaVisitor<T> visitor)
static <T> T
visit(Schema schema, TypeUtil.SchemaVisitor<T> visitor)
static <T> T
visit(Type type, TypeUtil.CustomOrderSchemaVisitor<T> visitor)
Used to traverse types with traversals other than pre-order.static <T> T
visit(Type type, TypeUtil.SchemaVisitor<T> visitor)
-
-
-
Method Detail
-
select
public static Types.StructType select(Types.StructType struct, java.util.Set<java.lang.Integer> fieldIds)
-
getProjectedIds
public static java.util.Set<java.lang.Integer> getProjectedIds(Schema schema)
-
getProjectedIds
public static java.util.Set<java.lang.Integer> getProjectedIds(Type type)
-
selectNot
public static Types.StructType selectNot(Types.StructType struct, java.util.Set<java.lang.Integer> fieldIds)
-
indexByName
public static java.util.Map<java.lang.String,java.lang.Integer> indexByName(Types.StructType struct)
-
indexByLowerCaseName
public static java.util.Map<java.lang.String,java.lang.Integer> indexByLowerCaseName(Types.StructType struct)
-
indexById
public static java.util.Map<java.lang.Integer,Types.NestedField> indexById(Types.StructType struct)
-
indexParents
public static java.util.Map<java.lang.Integer,java.lang.Integer> indexParents(Types.StructType struct)
-
assignFreshIds
public static Type assignFreshIds(Type type, TypeUtil.NextID nextId)
Assigns fresh ids from thenextId function
for all fields in a type.- Parameters:
type
- a typenextId
- an id assignment function- Returns:
- an structurally identical type with new ids assigned by the nextId function
-
assignFreshIds
public static Schema assignFreshIds(Schema schema, TypeUtil.NextID nextId)
Assigns fresh ids from thenextId function
for all fields in a schema.- Parameters:
schema
- a schemanextId
- an id assignment function- Returns:
- a structurally identical schema with new ids assigned by the nextId function
-
assignIncreasingFreshIds
public static Schema assignIncreasingFreshIds(Schema schema)
Assigns strictly increasing fresh ids for all fields in a schema, starting from 1.- Parameters:
schema
- a schema- Returns:
- a structurally identical schema with new ids assigned strictly increasing from 1
-
reassignIds
public static Schema reassignIds(Schema schema, Schema idSourceSchema)
Reassigns ids in a schema from another schema.Ids are determined by field names. If a field in the schema cannot be found in the source schema, this will throw IllegalArgumentException.
This will not alter a schema's structure, nullability, or types.
- Parameters:
schema
- the schema to have ids reassignedidSourceSchema
- the schema from which field ids will be used- Returns:
- an structurally identical schema with field ids matching the source schema
- Throws:
java.lang.IllegalArgumentException
- if a field cannot be found (by name) in the source schema
-
isPromotionAllowed
public static boolean isPromotionAllowed(Type from, Type.PrimitiveType to)
-
validateWriteSchema
public static void validateWriteSchema(Schema tableSchema, Schema writeSchema, java.lang.Boolean checkNullability, java.lang.Boolean checkOrdering)
Check whether we could write the iceberg table with the user-provided write schema.- Parameters:
tableSchema
- the table schema written in iceberg meta data.writeSchema
- the user-provided write schema.checkNullability
- If true, not allow to write optional values to a required field.checkOrdering
- If true, not allow input schema to have different ordering than table schema.
-
visit
public static <T> T visit(Schema schema, TypeUtil.SchemaVisitor<T> visitor)
-
visit
public static <T> T visit(Type type, TypeUtil.SchemaVisitor<T> visitor)
-
visit
public static <T> T visit(Schema schema, TypeUtil.CustomOrderSchemaVisitor<T> visitor)
-
visit
public static <T> T visit(Type type, TypeUtil.CustomOrderSchemaVisitor<T> visitor)
Used to traverse types with traversals other than pre-order.This passes a
Supplier
to eachvisitor
method that returns the result of traversing child types. Structs are passed anIterable
that traverses child fields during iteration.An example use is assigning column IDs, which should be done with a post-order traversal.
- Type Parameters:
T
- the type returned by the visitor- Parameters:
type
- a type to traverse with a visitorvisitor
- a custom order visitor- Returns:
- the result of traversing the given type with the visitor
-
decimalRequiredBytes
public static int decimalRequiredBytes(int precision)
-
-