Package org.apache.iceberg.hadoop

Class Util

  • public class Util
extends java.lang.Object

    • Method Summary

      All Methods Static Methods Concrete Methods 
      Modifier and Type Method Description
      static java.lang.String[] blockLocations​(CombinedScanTask task, org.apache.hadoop.conf.Configuration conf)  
      static java.lang.String[] blockLocations​(FileIO io, ScanTaskGroup<?> taskGroup)  
      static org.apache.hadoop.fs.FileSystem getFs​(org.apache.hadoop.fs.Path path, org.apache.hadoop.conf.Configuration conf)  
      static boolean mayHaveBlockLocations​(FileIO io, java.lang.String location)  
      static java.lang.String uriToString​(java.net.URI uri)
      From Apache Spark

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Field Detail

      • VERSION_HINT_FILENAME

        public static final java.lang.String VERSION_HINT_FILENAME
        See Also:
        Constant Field Values

    • Method Detail

      • getFs

        public static org.apache.hadoop.fs.FileSystem getFs​(org.apache.hadoop.fs.Path path,
                                                    org.apache.hadoop.conf.Configuration conf)

      • blockLocations

        public static java.lang.String[] blockLocations​(CombinedScanTask task,
                                                org.apache.hadoop.conf.Configuration conf)

      • blockLocations

        public static java.lang.String[] blockLocations​(FileIO io,
                                                ScanTaskGroup<?> taskGroup)

      • mayHaveBlockLocations

        public static boolean mayHaveBlockLocations​(FileIO io,
                                            java.lang.String location)

      • uriToString

        public static java.lang.String uriToString​(java.net.URI uri)
        From Apache Spark

        Convert URI to String. Since URI.toString does not decode the uri, e.g. change '%25' to '%'. Here we create a hadoop Path with the given URI, and rely on Path.toString to decode the uri

        Parameters:
        uri - the URI of the path
        Returns:
        the String of the path