Class SparkAvroWriter

  • All Implemented Interfaces:
    org.apache.avro.io.DatumWriter<org.apache.spark.sql.catalyst.InternalRow>, MetricsAwareDatumWriter<org.apache.spark.sql.catalyst.InternalRow>

    public class SparkAvroWriter
    extends java.lang.Object
    implements MetricsAwareDatumWriter<org.apache.spark.sql.catalyst.InternalRow>
    • Constructor Summary

      Constructors 
      Constructor Description
      SparkAvroWriter​(org.apache.spark.sql.types.StructType dsSchema)  
    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      java.util.stream.Stream<FieldMetrics> metrics()
      Returns a stream of FieldMetrics that this MetricsAwareDatumWriter keeps track of.
      void setSchema​(org.apache.avro.Schema schema)  
      void write​(org.apache.spark.sql.catalyst.InternalRow datum, org.apache.avro.io.Encoder out)  
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Constructor Detail

      • SparkAvroWriter

        public SparkAvroWriter​(org.apache.spark.sql.types.StructType dsSchema)
    • Method Detail

      • setSchema

        public void setSchema​(org.apache.avro.Schema schema)
        Specified by:
        setSchema in interface org.apache.avro.io.DatumWriter<org.apache.spark.sql.catalyst.InternalRow>
      • write

        public void write​(org.apache.spark.sql.catalyst.InternalRow datum,
                          org.apache.avro.io.Encoder out)
                   throws java.io.IOException
        Specified by:
        write in interface org.apache.avro.io.DatumWriter<org.apache.spark.sql.catalyst.InternalRow>
        Throws:
        java.io.IOException