程序包 | 说明 |
---|---|
org.apache.hadoop.filecache | |
org.apache.hadoop.fs |
An abstract file system API.
|
org.apache.hadoop.fs.ftp | |
org.apache.hadoop.fs.kfs |
A client for the Kosmos filesystem (KFS)
Introduction
This pages describes how to use Kosmos Filesystem
( KFS ) as a backing
store with Hadoop.
|
org.apache.hadoop.fs.permission | |
org.apache.hadoop.fs.s3 |
A distributed, block-based implementation of
FileSystem that uses Amazon S3
as a backing store. |
org.apache.hadoop.fs.s3native |
A distributed implementation of
FileSystem for reading and writing files on
Amazon S3. |
org.apache.hadoop.hdfs |
A distributed implementation of
FileSystem . |
org.apache.hadoop.hdfs.protocol | |
org.apache.hadoop.hdfs.server.namenode | |
org.apache.hadoop.hdfs.web | |
org.apache.hadoop.hdfs.web.resources | |
org.apache.hadoop.mapred |
A software framework for easily writing applications which process vast
amounts of data (multi-terabyte data-sets) parallelly on large clusters
(thousands of nodes) built of commodity hardware in a reliable, fault-tolerant
manner.
|
org.apache.hadoop.mapreduce | |
org.apache.hadoop.util |
Common utilities.
|
限定符和类型 | 方法和说明 |
---|---|
static long |
TrackerDistributedCacheManager.downloadCacheObject(Configuration conf,
URI source,
Path destination,
long desiredTimestamp,
boolean isArchive,
FsPermission permission)
Download a given path to the local file system.
|
限定符和类型 | 方法和说明 |
---|---|
FsPermission |
FileStatus.getPermission()
Get FsPermission associated with the file.
|
限定符和类型 | 方法和说明 |
---|---|
static FSDataOutputStream |
FileSystem.create(FileSystem fs,
Path file,
FsPermission permission)
create a file with the provided permission
The permission of the file is set to be the provided permission as in
setPermission, not permission&~umask
It is implemented using two RPCs.
|
FSDataOutputStream |
RawLocalFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
HarFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
FilterFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
abstract FSDataOutputStream |
FileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
ChecksumFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
RawLocalFileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
FSDataOutputStream |
FileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
已过时。
API only for 0.20-append
|
FSDataOutputStream |
ChecksumFileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress
reporting.
|
static boolean |
FileSystem.mkdirs(FileSystem fs,
Path dir,
FsPermission permission)
create a directory with the provided permission
The permission of the directory is set to be the provided permission as in
setPermission, not permission&~umask
|
boolean |
RawLocalFileSystem.mkdirs(Path f,
FsPermission permission)
Make the given file and all non-existent parents into
directories.
|
boolean |
HarFileSystem.mkdirs(Path f,
FsPermission permission)
not implemented.
|
boolean |
FilterFileSystem.mkdirs(Path f,
FsPermission permission)
Make the given file and all non-existent parents into
directories.
|
abstract boolean |
FileSystem.mkdirs(Path f,
FsPermission permission)
Make the given file and all non-existent parents into
directories.
|
static void |
FileUtil.setPermission(File f,
FsPermission permission)
Set permissions to the required value.
|
protected void |
FileStatus.setPermission(FsPermission permission)
Sets permission.
|
void |
RawLocalFileSystem.setPermission(Path p,
FsPermission permission)
Use the command chmod to set permission.
|
void |
HarFileSystem.setPermission(Path p,
FsPermission permisssion)
Not implemented.
|
void |
FilterFileSystem.setPermission(Path p,
FsPermission permission)
Set permission of a path.
|
void |
FileSystem.setPermission(Path p,
FsPermission permission)
Set permission of a path.
|
构造器和说明 |
---|
FileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
Path path) |
限定符和类型 | 方法和说明 |
---|---|
FSDataOutputStream |
FTPFileSystem.create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
A stream obtained via this call must be closed before using other APIs of
this class or else the invocation will block.
|
boolean |
FTPFileSystem.mkdirs(Path file,
FsPermission permission) |
限定符和类型 | 方法和说明 |
---|---|
FSDataOutputStream |
KosmosFileSystem.create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
boolean |
KosmosFileSystem.mkdirs(Path path,
FsPermission permission) |
限定符和类型 | 方法和说明 |
---|---|
FsPermission |
FsPermission.applyUMask(FsPermission umask)
Apply a umask to this permission and return a new one
|
static FsPermission |
FsPermission.createImmutable(short permission)
Create an immutable
FsPermission object. |
static FsPermission |
FsPermission.getDefault()
Get the default permission.
|
FsPermission |
PermissionStatus.getPermission()
Return permission
|
static FsPermission |
FsPermission.getUMask(Configuration conf)
Get the user file creation mask (umask)
UMASK_LABEL config param has umask value that is either symbolic
or octal. |
static FsPermission |
FsPermission.read(DataInput in)
Create and initialize a
FsPermission from DataInput . |
static FsPermission |
FsPermission.valueOf(String unixSymbolicPermission)
Create a FsPermission from a Unix symbolic permission string
|
限定符和类型 | 方法和说明 |
---|---|
PermissionStatus |
PermissionStatus.applyUMask(FsPermission umask)
Apply umask.
|
FsPermission |
FsPermission.applyUMask(FsPermission umask)
Apply a umask to this permission and return a new one
|
static PermissionStatus |
PermissionStatus.createImmutable(String user,
String group,
FsPermission permission)
Create an immutable
PermissionStatus object. |
static void |
FsPermission.setUMask(Configuration conf,
FsPermission umask)
Set the user file creation mask (umask)
|
static void |
PermissionStatus.write(DataOutput out,
String username,
String groupname,
FsPermission permission)
Serialize a
PermissionStatus from its base components. |
构造器和说明 |
---|
FsPermission(FsPermission other)
Copy constructor
|
PermissionStatus(String user,
String group,
FsPermission permission)
Constructor
|
限定符和类型 | 方法和说明 |
---|---|
FSDataOutputStream |
S3FileSystem.create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
boolean |
S3FileSystem.mkdirs(Path path,
FsPermission permission) |
限定符和类型 | 方法和说明 |
---|---|
FSDataOutputStream |
NativeS3FileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
boolean |
NativeS3FileSystem.mkdirs(Path f,
FsPermission permission) |
限定符和类型 | 方法和说明 |
---|---|
FSDataOutputStream |
HftpFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
FSDataOutputStream |
DistributedFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
OutputStream |
DFSClient.create(String src,
FsPermission permission,
boolean overwrite,
boolean createParent,
short replication,
long blockSize,
Progressable progress,
int buffersize)
Create a new dfs file with the specified block replication
with write-progress reporting and return an output stream for writing
into the file.
|
OutputStream |
DFSClient.create(String src,
FsPermission permission,
boolean overwrite,
short replication,
long blockSize,
Progressable progress,
int buffersize)
Call
DFSClient.create(String,FsPermission,boolean,boolean,short,long,Progressable,int)
with createParent set to true. |
FSDataOutputStream |
DistributedFileSystem.createNonRecursive(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Same as create(), except fails if parent directory doesn't already exist.
|
boolean |
HftpFileSystem.mkdirs(Path f,
FsPermission permission) |
boolean |
DistributedFileSystem.mkdirs(Path f,
FsPermission permission) |
boolean |
DFSClient.mkdirs(String src,
FsPermission permission)
Create a directory (or hierarchy of directories) with the given
name and permission.
|
void |
DistributedFileSystem.setPermission(Path p,
FsPermission permission)
Set permission of a path.
|
void |
DFSClient.setPermission(String src,
FsPermission permission)
Set permissions to a file or directory.
|
限定符和类型 | 方法和说明 |
---|---|
FsPermission |
HdfsFileStatus.getPermission()
Get FsPermission associated with the file.
|
限定符和类型 | 方法和说明 |
---|---|
void |
ClientProtocol.create(String src,
FsPermission masked,
String clientName,
boolean overwrite,
boolean createParent,
short replication,
long blockSize)
Create a new file entry in the namespace.
|
void |
ClientProtocol.create(String src,
FsPermission masked,
String clientName,
boolean overwrite,
short replication,
long blockSize)
Create a new file entry in the namespace.
|
boolean |
ClientProtocol.mkdirs(String src,
FsPermission masked)
Create a directory (or hierarchy of directories) with the given
name and permission.
|
void |
ClientProtocol.setPermission(String src,
FsPermission permission)
Set permissions for an existing file/directory.
|
构造器和说明 |
---|
HdfsFileStatus(long length,
boolean isdir,
int block_replication,
long blocksize,
long modification_time,
long access_time,
FsPermission permission,
String owner,
String group,
byte[] path)
Constructor
|
限定符和类型 | 方法和说明 |
---|---|
void |
NameNode.create(String src,
FsPermission masked,
String clientName,
boolean overwrite,
boolean createParent,
short replication,
long blockSize)
Create a new file entry in the namespace.
|
void |
NameNode.create(String src,
FsPermission masked,
String clientName,
boolean overwrite,
short replication,
long blockSize)
已过时。
|
boolean |
NameNode.mkdirs(String src,
FsPermission masked)
Create a directory (or hierarchy of directories) with the given
name and permission.
|
void |
NameNode.setPermission(String src,
FsPermission permissions)
Set permissions for an existing file/directory.
|
void |
FSNamesystem.setPermission(String src,
FsPermission permission)
Set permissions for an existing file.
|
限定符和类型 | 方法和说明 |
---|---|
FSDataOutputStream |
WebHdfsFileSystem.create(Path f,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress) |
boolean |
WebHdfsFileSystem.mkdirs(Path f,
FsPermission permission) |
void |
WebHdfsFileSystem.setPermission(Path p,
FsPermission permission) |
限定符和类型 | 方法和说明 |
---|---|
FsPermission |
PermissionParam.getFsPermission() |
构造器和说明 |
---|
PermissionParam(FsPermission value)
Constructor.
|
限定符和类型 | 字段和说明 |
---|---|
static FsPermission |
TaskController.TASK_LAUNCH_SCRIPT_PERMISSION |
限定符和类型 | 字段和说明 |
---|---|
static FsPermission |
JobSubmissionFiles.JOB_DIR_PERMISSION |
static FsPermission |
JobSubmissionFiles.JOB_FILE_PERMISSION |
限定符和类型 | 方法和说明 |
---|---|
static void |
DiskChecker.checkDir(LocalFileSystem localFS,
Path dir,
FsPermission expected)
Create the local directory if necessary, check permissions and also ensure
it can be read from and written into.
|
static boolean |
DiskChecker.mkdirsWithExistsAndPermissionCheck(LocalFileSystem localFS,
Path dir,
FsPermission expected)
Create the directory or check permissions if it already exists.
|
Copyright © 2009 The Apache Software Foundation