Package org.apache.iceberg.spark.data
Class SparkAvroReader
- java.lang.Object
-
- org.apache.iceberg.spark.data.SparkAvroReader
-
- All Implemented Interfaces:
org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>
,SupportsRowPosition
public class SparkAvroReader extends java.lang.Object implements org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>, SupportsRowPosition
-
-
Constructor Summary
Constructors Constructor Description SparkAvroReader(Schema expectedSchema, org.apache.avro.Schema readSchema)
SparkAvroReader(Schema expectedSchema, org.apache.avro.Schema readSchema, java.util.Map<java.lang.Integer,?> constants)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description org.apache.spark.sql.catalyst.InternalRow
read(org.apache.spark.sql.catalyst.InternalRow reuse, org.apache.avro.io.Decoder decoder)
void
setRowPositionSupplier(java.util.function.Supplier<java.lang.Long> posSupplier)
void
setSchema(org.apache.avro.Schema newFileSchema)
-
-
-
Method Detail
-
setSchema
public void setSchema(org.apache.avro.Schema newFileSchema)
- Specified by:
setSchema
in interfaceorg.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>
-
read
public org.apache.spark.sql.catalyst.InternalRow read(org.apache.spark.sql.catalyst.InternalRow reuse, org.apache.avro.io.Decoder decoder) throws java.io.IOException
- Specified by:
read
in interfaceorg.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>
- Throws:
java.io.IOException
-
setRowPositionSupplier
public void setRowPositionSupplier(java.util.function.Supplier<java.lang.Long> posSupplier)
- Specified by:
setRowPositionSupplier
in interfaceSupportsRowPosition
-
-