Package org.apache.iceberg.spark.data

Class SparkPlannedAvroReader

java.lang.Object

org.apache.iceberg.spark.data.SparkPlannedAvroReader

All Implemented Interfaces:

org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>, SupportsRowPosition

public class SparkPlannedAvroReader
extends Object
implements org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>, SupportsRowPosition

Method Summary

Modifier and Type	Method	Description
static SparkPlannedAvroReader	create(Schema schema)
static SparkPlannedAvroReader	create(Schema schema, Map<Integer,?> constants)
org.apache.spark.sql.catalyst.InternalRow	read(org.apache.spark.sql.catalyst.InternalRow reuse, org.apache.avro.io.Decoder decoder)
void	setRowPositionSupplier(Supplier<Long> posSupplier)
void	setSchema(org.apache.avro.Schema fileSchema)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

create

public static SparkPlannedAvroReader create(Schema schema)

create

public static SparkPlannedAvroReader create(Schema schema,
 Map<Integer,?> constants)

setSchema

public void setSchema(org.apache.avro.Schema fileSchema)

Specified by:

setSchema in interface org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>

read

public org.apache.spark.sql.catalyst.InternalRow read(org.apache.spark.sql.catalyst.InternalRow reuse,
 org.apache.avro.io.Decoder decoder)
                                               throws IOException

Specified by:

read in interface org.apache.avro.io.DatumReader<org.apache.spark.sql.catalyst.InternalRow>

Throws:

IOException

setRowPositionSupplier

public void setRowPositionSupplier(Supplier<Long> posSupplier)

Specified by:

setRowPositionSupplier in interface SupportsRowPosition