Package org.apache.iceberg.spark.data

Class SparkAvroReader

  • All Implemented Interfaces:
    org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>, SupportsRowPosition
    public class SparkAvroReader
extends java.lang.Object
implements org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>, SupportsRowPosition

    • Constructor Summary

      Constructors 
      Constructor Description
      SparkAvroReader​(Schema expectedSchema, org.apache.avro.Schema readSchema)  
      SparkAvroReader​(Schema expectedSchema, org.apache.avro.Schema readSchema, java.util.Map<java.lang.Integer,​?> constants)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      org.apache.spark.sql.catalyst.InternalRow read​(org.apache.spark.sql.catalyst.InternalRow reuse, org.apache.avro.io.Decoder decoder)  
      void setRowPositionSupplier​(java.util.function.Supplier<java.lang.Long> posSupplier)  
      void setSchema​(org.apache.avro.Schema newFileSchema)  

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • SparkAvroReader

        public SparkAvroReader​(Schema expectedSchema,
                       org.apache.avro.Schema readSchema)

      • SparkAvroReader

        public SparkAvroReader​(Schema expectedSchema,
                       org.apache.avro.Schema readSchema,
                       java.util.Map<java.lang.Integer,​?> constants)

    • Method Detail

      • setSchema

        public void setSchema​(org.apache.avro.Schema newFileSchema)
        Specified by:
        setSchema in interface org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>

      • read

        public org.apache.spark.sql.catalyst.InternalRow read​(org.apache.spark.sql.catalyst.InternalRow reuse,
                                                      org.apache.avro.io.Decoder decoder)
                                               throws java.io.IOException
        Specified by:
        read in interface org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>
        Throws:
        java.io.IOException