Class SparkOrcWriter

  • All Implemented Interfaces:
    OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>

    public class SparkOrcWriter
    extends java.lang.Object
    implements OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>
    This class acts as an adaptor from an OrcFileAppender to a FileAppender<InternalRow>.
    • Constructor Summary

      Constructors 
      Constructor Description
      SparkOrcWriter​(Schema iSchema, org.apache.orc.TypeDescription orcSchema)  
    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      java.util.stream.Stream<FieldMetrics<?>> metrics()
      Returns a stream of FieldMetrics that this OrcRowWriter keeps track of.
      void write​(org.apache.spark.sql.catalyst.InternalRow value, org.apache.orc.storage.ql.exec.vector.VectorizedRowBatch output)
      Writes or appends a row to ORC's VectorizedRowBatch.
      java.util.List<OrcValueWriter<?>> writers()  
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Constructor Detail

      • SparkOrcWriter

        public SparkOrcWriter​(Schema iSchema,
                              org.apache.orc.TypeDescription orcSchema)
    • Method Detail

      • write

        public void write​(org.apache.spark.sql.catalyst.InternalRow value,
                          org.apache.orc.storage.ql.exec.vector.VectorizedRowBatch output)
        Description copied from interface: OrcRowWriter
        Writes or appends a row to ORC's VectorizedRowBatch.
        Specified by:
        write in interface OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>
        Parameters:
        value - the row data value to write.
        output - the VectorizedRowBatch to which the output will be written.
      • metrics

        public java.util.stream.Stream<FieldMetrics<?>> metrics()
        Description copied from interface: OrcRowWriter
        Returns a stream of FieldMetrics that this OrcRowWriter keeps track of.
        Specified by:
        metrics in interface OrcRowWriter<org.apache.spark.sql.catalyst.InternalRow>