org.apache.iceberg.spark.data

Class SparkOrcWriter

java.lang.Object

org.apache.iceberg.spark.data.SparkOrcWriter

All Implemented Interfaces:

OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>

public class SparkOrcWriter
extends java.lang.Object
implements OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>

This class acts as an adaptor from an OrcFileAppender to a FileAppender<InternalRow>.

Constructor Summary

Constructors

Constructor and Description
SparkOrcWriter(Schema iSchema, org.apache.orc.TypeDescription orcSchema)

Method Summary

Modifier and Type	Method and Description
java.util.stream.Stream<FieldMetrics<?>>	metrics() Returns a stream of FieldMetrics that this OrcRowWriter keeps track of.
void	write(org.apache.spark.sql.catalyst.InternalRow value, org.apache.orc.storage.ql.exec.vector.VectorizedRowBatch output) Writes or appends a row to ORC's VectorizedRowBatch.
java.util.List<OrcValueWriter<?>>	writers()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkOrcWriter

public SparkOrcWriter(Schema iSchema,
                      org.apache.orc.TypeDescription orcSchema)

Method Detail

write

public void write(org.apache.spark.sql.catalyst.InternalRow value,
                  org.apache.orc.storage.ql.exec.vector.VectorizedRowBatch output)

Description copied from interface: OrcRowWriter

Writes or appends a row to ORC's VectorizedRowBatch.

Specified by:

write in interface OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>

Parameters:

value - the row data value to write.

output - the VectorizedRowBatch to which the output will be written.

writers

public java.util.List<OrcValueWriter<?>> writers()

Specified by:

writers in interface OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>

metrics

public java.util.stream.Stream<FieldMetrics<?>> metrics()

Description copied from interface: OrcRowWriter

Returns a stream of FieldMetrics that this OrcRowWriter keeps track of.

Specified by:

metrics in interface OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>