org.apache.hadoop.fs

类 FileUtil

java.lang.Object

org.apache.hadoop.fs.FileUtil

public class FileUtil
extends Object

A collection of file-processing util methods

构造器概要

构造器

构造器和说明
FileUtil()

方法概要

方法

限定符和类型	方法和说明
static int	chmod(String filename, String perm) Change the permissions on a filename.
static int	chmod(String filename, String perm, boolean recursive) Change the permissions on a file / directory, recursively, if needed.
static boolean	copy(File src, FileSystem dstFS, Path dst, boolean deleteSource, Configuration conf) Copy local files to a FileSystem.
static boolean	copy(FileSystem srcFS, Path[] srcs, FileSystem dstFS, Path dst, boolean deleteSource, boolean overwrite, Configuration conf)
static boolean	copy(FileSystem srcFS, Path src, File dst, boolean deleteSource, Configuration conf) Copy FileSystem files to local files.
static boolean	copy(FileSystem srcFS, Path src, FileSystem dstFS, Path dst, boolean deleteSource, boolean overwrite, Configuration conf) Copy files between FileSystems.
static boolean	copy(FileSystem srcFS, Path src, FileSystem dstFS, Path dst, boolean deleteSource, Configuration conf) Copy files between FileSystems.
static boolean	copyMerge(FileSystem srcFS, Path srcDir, FileSystem dstFS, Path dstFile, boolean deleteSource, Configuration conf, String addString) Copy all files in a directory to one output file (merge).
static File	createLocalTempFile(File basefile, String prefix, boolean isDeleteOnExit) Create a tmp file for a base file.
static boolean	fullyDelete(File dir) Delete a directory and all its contents.
static void	fullyDelete(FileSystem fs, Path dir) 已过时。 Use FileSystem.delete(Path, boolean)
static boolean	fullyDeleteContents(File dir) Delete the contents of a directory, not the directory itself.
static long	getDU(File dir) Takes an input dir and returns the du on that local directory.
static String[]	list(File dir) A wrapper for File.list().
static File[]	listFiles(File dir) A wrapper for File.listFiles().
static String	makeShellPath(File file) Convert a os-native filename to a path that works for the shell.
static String	makeShellPath(File file, boolean makeCanonicalPath) Convert a os-native filename to a path that works for the shell.
static String	makeShellPath(String filename) Convert a os-native filename to a path that works for the shell.
static void	replaceFile(File src, File target) Move the src file to the name specified by target.
static void	setPermission(File f, FsPermission permission) Set permissions to the required value.
static Path[]	stat2Paths(FileStatus[] stats) convert an array of FileStatus to an array of Path
static Path[]	stat2Paths(FileStatus[] stats, Path path) convert an array of FileStatus to an array of Path.
static int	symLink(String target, String linkname) Create a soft link between a src and destination only on a local disk.
static void	unTar(File inFile, File untarDir) Given a Tar File as input it will untar the file in a the untar directory passed as the second parameter This utility will untar ".tar" files and ".tar.gz","tgz" files.
static void	unZip(File inFile, File unzipDir) Given a File input it will unzip the file in a the unzip directory passed as the second parameter

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

FileUtil

public FileUtil()

方法详细资料

stat2Paths

public static Path[] stat2Paths(FileStatus[] stats)

convert an array of FileStatus to an array of Path

参数:

stats - an array of FileStatus objects

返回:

an array of paths corresponding to the input

stat2Paths

public static Path[] stat2Paths(FileStatus[] stats,
                Path path)

convert an array of FileStatus to an array of Path. If stats if null, return path

参数:

stats - an array of FileStatus objects

path - default path to return in stats is null

返回:

an array of paths corresponding to the input

fullyDelete

public static boolean fullyDelete(File dir)
                           throws IOException

Delete a directory and all its contents. If we return false, the directory may be partially-deleted.

抛出:

IOException

fullyDeleteContents

public static boolean fullyDeleteContents(File dir)
                                   throws IOException

Delete the contents of a directory, not the directory itself. If we return false, the directory may be partially-deleted.

抛出:

IOException

fullyDelete

@Deprecated
public static void fullyDelete(FileSystem fs,
                          Path dir)
                        throws IOException

已过时。 Use FileSystem.delete(Path, boolean)

Recursively delete a directory.

参数:

fs - FileSystem on which the path is present

dir - directory to recursively delete

抛出:

IOException

copy

public static boolean copy(FileSystem srcFS,
           Path src,
           FileSystem dstFS,
           Path dst,
           boolean deleteSource,
           Configuration conf)
                    throws IOException

Copy files between FileSystems.

抛出:

IOException

copy

public static boolean copy(FileSystem srcFS,
           Path[] srcs,
           FileSystem dstFS,
           Path dst,
           boolean deleteSource,
           boolean overwrite,
           Configuration conf)
                    throws IOException

抛出:

IOException

copy

public static boolean copy(FileSystem srcFS,
           Path src,
           FileSystem dstFS,
           Path dst,
           boolean deleteSource,
           boolean overwrite,
           Configuration conf)
                    throws IOException

Copy files between FileSystems.

抛出:

IOException

copyMerge

public static boolean copyMerge(FileSystem srcFS,
                Path srcDir,
                FileSystem dstFS,
                Path dstFile,
                boolean deleteSource,
                Configuration conf,
                String addString)
                         throws IOException

Copy all files in a directory to one output file (merge).

抛出:

IOException

copy

public static boolean copy(File src,
           FileSystem dstFS,
           Path dst,
           boolean deleteSource,
           Configuration conf)
                    throws IOException

Copy local files to a FileSystem.

抛出:

IOException

copy

public static boolean copy(FileSystem srcFS,
           Path src,
           File dst,
           boolean deleteSource,
           Configuration conf)
                    throws IOException

Copy FileSystem files to local files.

抛出:

IOException

makeShellPath

public static String makeShellPath(String filename)
                            throws IOException

Convert a os-native filename to a path that works for the shell.

参数:

filename - The filename to convert

返回:

The unix pathname

抛出:

IOException - on windows, there can be problems with the subprocess

makeShellPath

public static String makeShellPath(File file)
                            throws IOException

Convert a os-native filename to a path that works for the shell.

参数:

file - The filename to convert

返回:

The unix pathname

抛出:

IOException - on windows, there can be problems with the subprocess

makeShellPath

public static String makeShellPath(File file,
                   boolean makeCanonicalPath)
                            throws IOException

Convert a os-native filename to a path that works for the shell.

参数:

file - The filename to convert

makeCanonicalPath - Whether to make canonical path for the file passed

返回:

The unix pathname

抛出:

IOException - on windows, there can be problems with the subprocess

getDU

public static long getDU(File dir)

Takes an input dir and returns the du on that local directory. Very basic implementation.

参数:

dir - The input dir to get the disk space of this local dir

返回:

The total disk space of the input local directory

unZip

public static void unZip(File inFile,
         File unzipDir)
                  throws IOException

Given a File input it will unzip the file in a the unzip directory passed as the second parameter

参数:

inFile - The zip file as input

unzipDir - The unzip directory where to unzip the zip file.

抛出:

IOException

unTar

public static void unTar(File inFile,
         File untarDir)
                  throws IOException

Given a Tar File as input it will untar the file in a the untar directory passed as the second parameter This utility will untar ".tar" files and ".tar.gz","tgz" files.

参数:

inFile - The tar file as input.

untarDir - The untar directory where to untar the tar file.

抛出:

IOException

symLink

public static int symLink(String target,
          String linkname)
                   throws IOException

Create a soft link between a src and destination only on a local disk. HDFS does not support this

参数:

target - the target for symlink

linkname - the symlink

返回:

value returned by the command

抛出:

IOException

chmod

public static int chmod(String filename,
        String perm)
                 throws IOException,
                        InterruptedException

Change the permissions on a filename.

参数:

filename - the name of the file to change

perm - the permission string

返回:

the exit code from the command

抛出:

IOException

InterruptedException

chmod

public static int chmod(String filename,
        String perm,
        boolean recursive)
                 throws IOException

Change the permissions on a file / directory, recursively, if needed.

参数:

filename - name of the file whose permissions are to change

perm - permission string

recursive - true, if permissions should be changed recursively

返回:

the exit code from the command.

抛出:

IOException

InterruptedException

setPermission

public static void setPermission(File f,
                 FsPermission permission)
                          throws IOException

Set permissions to the required value. Uses the java primitives instead of forking if group == other.

参数:

f - the file to change

permission - the new permissions

抛出:

IOException

createLocalTempFile

public static final File createLocalTempFile(File basefile,
                       String prefix,
                       boolean isDeleteOnExit)
                                      throws IOException

Create a tmp file for a base file.

参数:

basefile - the base file of the tmp

prefix - file name prefix of tmp

isDeleteOnExit - if true, the tmp will be deleted when the VM exits

返回:

a newly created tmp file

抛出:

IOException - If a tmp file cannot created

另请参阅:

File.createTempFile(String, String, File), File.deleteOnExit()

replaceFile

public static void replaceFile(File src,
               File target)
                        throws IOException

Move the src file to the name specified by target.

参数:

src - the source file

target - the target file

抛出:

IOException - If this operation fails

listFiles

public static File[] listFiles(File dir)
                        throws IOException

A wrapper for File.listFiles(). This java.io API returns null when a dir is not a directory or for any I/O error. Instead of having null check everywhere File#listFiles() is used, we will add utility API to get around this problem. For the majority of cases where we prefer an IOException to be thrown.

参数:

dir - directory for which listing should be performed

返回:

list of files or empty list

抛出:

IOException - for invalid directory or for a bad disk.

list

public static String[] list(File dir)
                     throws IOException

A wrapper for File.list(). This java.io API returns null when a dir is not a directory or for any I/O error. Instead of having null check everywhere File#list() is used, we will add utility API to get around this problem. For the majority of cases where we prefer an IOException to be thrown.

参数:

dir - directory for which listing should be performed

返回:

list of file names or empty string list

抛出:

IOException - for invalid directory or for a bad disk.