org.apache.iceberg.spark.data

Class SparkAvroReader

java.lang.Object

org.apache.iceberg.spark.data.SparkAvroReader

All Implemented Interfaces:

org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>, SupportsRowPosition

public class SparkAvroReader
extends java.lang.Object
implements org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>, SupportsRowPosition

Constructor Summary

Constructors

Constructor and Description
SparkAvroReader(Schema expectedSchema, org.apache.avro.Schema readSchema)
SparkAvroReader(Schema expectedSchema, org.apache.avro.Schema readSchema, java.util.Map<java.lang.Integer,?> constants)

Method Summary

Modifier and Type	Method and Description
org.apache.spark.sql.catalyst.InternalRow	read(org.apache.spark.sql.catalyst.InternalRow reuse, org.apache.avro.io.Decoder decoder)
void	setRowPositionSupplier(java.util.function.Supplier<java.lang.Long> posSupplier)
void	setSchema(org.apache.avro.Schema newFileSchema)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkAvroReader

public SparkAvroReader(Schema expectedSchema,
                       org.apache.avro.Schema readSchema)

SparkAvroReader

public SparkAvroReader(Schema expectedSchema,
                       org.apache.avro.Schema readSchema,
                       java.util.Map<java.lang.Integer,?> constants)

Method Detail

setSchema

public void setSchema(org.apache.avro.Schema newFileSchema)

Specified by:

setSchema in interface org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>

read

public org.apache.spark.sql.catalyst.InternalRow read(org.apache.spark.sql.catalyst.InternalRow reuse,
                                                      org.apache.avro.io.Decoder decoder)
                                               throws java.io.IOException

Specified by:

read in interface org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>

Throws:

java.io.IOException

setRowPositionSupplier

public void setRowPositionSupplier(java.util.function.Supplier<java.lang.Long> posSupplier)

Specified by:

setRowPositionSupplier in interface SupportsRowPosition