Package org.apache.iceberg.hadoop
Class Util
java.lang.Object
org.apache.iceberg.hadoop.Util
-
Field Summary
-
Method Summary
Modifier and TypeMethodDescriptionstatic String[]
blockLocations
(CombinedScanTask task, org.apache.hadoop.conf.Configuration conf) static String[]
blockLocations
(FileIO io, ScanTaskGroup<?> taskGroup) static org.apache.hadoop.fs.FileSystem
getFs
(org.apache.hadoop.fs.Path path, org.apache.hadoop.conf.Configuration conf) static boolean
mayHaveBlockLocations
(FileIO io, String location) static String
uriToString
(URI uri) From Apache Spark
-
Field Details
-
VERSION_HINT_FILENAME
- See Also:
-
-
Method Details
-
getFs
public static org.apache.hadoop.fs.FileSystem getFs(org.apache.hadoop.fs.Path path, org.apache.hadoop.conf.Configuration conf) -
blockLocations
public static String[] blockLocations(CombinedScanTask task, org.apache.hadoop.conf.Configuration conf) -
blockLocations
-
mayHaveBlockLocations
-
uriToString
From Apache SparkConvert URI to String. Since URI.toString does not decode the uri, e.g. change '%25' to '%'. Here we create a hadoop Path with the given URI, and rely on Path.toString to decode the uri
- Parameters:
uri
- the URI of the path- Returns:
- the String of the path
-