Class SparkAvroReader

  • All Implemented Interfaces:
    org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>, SupportsRowPosition

    public class SparkAvroReader
    extends java.lang.Object
    implements org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>, SupportsRowPosition
    • Constructor Summary

      Constructors 
      Constructor Description
      SparkAvroReader​(Schema expectedSchema, org.apache.avro.Schema readSchema)  
      SparkAvroReader​(Schema expectedSchema, org.apache.avro.Schema readSchema, java.util.Map<java.lang.Integer,​?> constants)  
    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      org.apache.spark.sql.catalyst.InternalRow read​(org.apache.spark.sql.catalyst.InternalRow reuse, org.apache.avro.io.Decoder decoder)  
      void setRowPositionSupplier​(java.util.function.Supplier<java.lang.Long> posSupplier)  
      void setSchema​(org.apache.avro.Schema newFileSchema)  
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Constructor Detail

      • SparkAvroReader

        public SparkAvroReader​(Schema expectedSchema,
                               org.apache.avro.Schema readSchema)
      • SparkAvroReader

        public SparkAvroReader​(Schema expectedSchema,
                               org.apache.avro.Schema readSchema,
                               java.util.Map<java.lang.Integer,​?> constants)
    • Method Detail

      • setSchema

        public void setSchema​(org.apache.avro.Schema newFileSchema)
        Specified by:
        setSchema in interface org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>
      • read

        public org.apache.spark.sql.catalyst.InternalRow read​(org.apache.spark.sql.catalyst.InternalRow reuse,
                                                              org.apache.avro.io.Decoder decoder)
                                                       throws java.io.IOException
        Specified by:
        read in interface org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>
        Throws:
        java.io.IOException