org.apache.iceberg.spark.data

Class SparkAvroWriter

java.lang.Object

org.apache.iceberg.spark.data.SparkAvroWriter

All Implemented Interfaces:

org.apache.avro.io.DatumWriter<org.apache.spark.sql.catalyst.InternalRow>, MetricsAwareDatumWriter<org.apache.spark.sql.catalyst.InternalRow>

public class SparkAvroWriter
extends java.lang.Object
implements MetricsAwareDatumWriter<org.apache.spark.sql.catalyst.InternalRow>

Constructor Summary

Constructors

Constructor and Description
SparkAvroWriter(org.apache.spark.sql.types.StructType dsSchema)

Method Summary

Modifier and Type	Method and Description
java.util.stream.Stream<FieldMetrics>	metrics() Returns a stream of FieldMetrics that this MetricsAwareDatumWriter keeps track of.
void	setSchema(org.apache.avro.Schema schema)
void	write(org.apache.spark.sql.catalyst.InternalRow datum, org.apache.avro.io.Encoder out)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkAvroWriter

public SparkAvroWriter(org.apache.spark.sql.types.StructType dsSchema)

Method Detail

setSchema

public void setSchema(org.apache.avro.Schema schema)

Specified by:

setSchema in interface org.apache.avro.io.DatumWriter<org.apache.spark.sql.catalyst.InternalRow>

write

public void write(org.apache.spark.sql.catalyst.InternalRow datum,
                  org.apache.avro.io.Encoder out)
           throws java.io.IOException

Specified by:

write in interface org.apache.avro.io.DatumWriter<org.apache.spark.sql.catalyst.InternalRow>

Throws:

java.io.IOException

metrics

public java.util.stream.Stream<FieldMetrics> metrics()

Description copied from interface: MetricsAwareDatumWriter

Returns a stream of FieldMetrics that this MetricsAwareDatumWriter keeps track of.

Specified by:

metrics in interface MetricsAwareDatumWriter<org.apache.spark.sql.catalyst.InternalRow>