org.apache.iceberg.hadoop

Class HadoopOutputFile

java.lang.Object

org.apache.iceberg.hadoop.HadoopOutputFile

All Implemented Interfaces:

OutputFile

public class HadoopOutputFile
extends java.lang.Object
implements OutputFile

OutputFile implementation using the Hadoop FileSystem API.

Method Summary

Modifier and Type	Method and Description
PositionOutputStream	create() Create a new file and return a PositionOutputStream to it.
PositionOutputStream	createOrOverwrite() Create a new file and return a PositionOutputStream to it.
static OutputFile	fromLocation(java.lang.CharSequence location, org.apache.hadoop.conf.Configuration conf)
static OutputFile	fromLocation(java.lang.CharSequence location, org.apache.hadoop.fs.FileSystem fs)
static OutputFile	fromPath(org.apache.hadoop.fs.Path path, org.apache.hadoop.conf.Configuration conf)
static OutputFile	fromPath(org.apache.hadoop.fs.Path path, org.apache.hadoop.fs.FileSystem fs)
static OutputFile	fromPath(org.apache.hadoop.fs.Path path, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.conf.Configuration conf)
org.apache.hadoop.conf.Configuration	getConf()
org.apache.hadoop.fs.FileSystem	getFileSystem()
org.apache.hadoop.fs.Path	getPath()
java.lang.String	location() Return the location this output file will create.
InputFile	toInputFile() Return an InputFile for the location of this output file.
java.lang.String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Method Detail

fromLocation

public static OutputFile fromLocation(java.lang.CharSequence location,
                                      org.apache.hadoop.conf.Configuration conf)

fromLocation

public static OutputFile fromLocation(java.lang.CharSequence location,
                                      org.apache.hadoop.fs.FileSystem fs)

fromPath

public static OutputFile fromPath(org.apache.hadoop.fs.Path path,
                                  org.apache.hadoop.conf.Configuration conf)

fromPath

public static OutputFile fromPath(org.apache.hadoop.fs.Path path,
                                  org.apache.hadoop.fs.FileSystem fs)

fromPath

public static OutputFile fromPath(org.apache.hadoop.fs.Path path,
                                  org.apache.hadoop.fs.FileSystem fs,
                                  org.apache.hadoop.conf.Configuration conf)

create

public PositionOutputStream create()

Description copied from interface: OutputFile

Create a new file and return a PositionOutputStream to it.

If the file already exists, this will throw an exception.

Specified by:

create in interface OutputFile

Returns:

an output stream that can report its position

createOrOverwrite

public PositionOutputStream createOrOverwrite()

Description copied from interface: OutputFile

Create a new file and return a PositionOutputStream to it.

If the file already exists, this will not throw an exception and will replace the file.

Specified by:

createOrOverwrite in interface OutputFile

Returns:

an output stream that can report its position

getPath

public org.apache.hadoop.fs.Path getPath()

getConf

public org.apache.hadoop.conf.Configuration getConf()

getFileSystem

public org.apache.hadoop.fs.FileSystem getFileSystem()

location

public java.lang.String location()

Description copied from interface: OutputFile

Return the location this output file will create.

Specified by:

location in interface OutputFile

Returns:

the location of this output file

toInputFile

public InputFile toInputFile()

Description copied from interface: OutputFile

Return an InputFile for the location of this output file.

Specified by:

toInputFile in interface OutputFile

Returns:

an input file for the location of this output file

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object