Package org.apache.iceberg.spark.data
Class SparkOrcWriter
- java.lang.Object
-
- org.apache.iceberg.spark.data.SparkOrcWriter
-
- All Implemented Interfaces:
OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>
public class SparkOrcWriter extends java.lang.Object implements OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>
This class acts as an adaptor from an OrcFileAppender to a FileAppender<InternalRow>.
-
-
Constructor Summary
Constructors Constructor Description SparkOrcWriter(Schema iSchema, org.apache.orc.TypeDescription orcSchema)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description java.util.stream.Stream<FieldMetrics<?>>
metrics()
Returns a stream ofFieldMetrics
that this OrcRowWriter keeps track of.void
write(org.apache.spark.sql.catalyst.InternalRow value, org.apache.orc.storage.ql.exec.vector.VectorizedRowBatch output)
Writes or appends a row to ORC's VectorizedRowBatch.java.util.List<OrcValueWriter<?>>
writers()
-
-
-
Constructor Detail
-
SparkOrcWriter
public SparkOrcWriter(Schema iSchema, org.apache.orc.TypeDescription orcSchema)
-
-
Method Detail
-
write
public void write(org.apache.spark.sql.catalyst.InternalRow value, org.apache.orc.storage.ql.exec.vector.VectorizedRowBatch output)
Description copied from interface:OrcRowWriter
Writes or appends a row to ORC's VectorizedRowBatch.- Specified by:
write
in interfaceOrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>
- Parameters:
value
- the row data value to write.output
- the VectorizedRowBatch to which the output will be written.
-
writers
public java.util.List<OrcValueWriter<?>> writers()
- Specified by:
writers
in interfaceOrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>
-
metrics
public java.util.stream.Stream<FieldMetrics<?>> metrics()
Description copied from interface:OrcRowWriter
Returns a stream ofFieldMetrics
that this OrcRowWriter keeps track of.- Specified by:
metrics
in interfaceOrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>
-
-