| 程序包 | 说明 |
|---|---|
| org.apache.hadoop.filecache | |
| org.apache.hadoop.fs |
An abstract file system API.
|
| org.apache.hadoop.fs.ftp | |
| org.apache.hadoop.fs.kfs |
A client for the Kosmos filesystem (KFS)
Introduction
This pages describes how to use Kosmos Filesystem
( KFS ) as a backing
store with Hadoop.
|
| org.apache.hadoop.fs.permission | |
| org.apache.hadoop.fs.s3 |
A distributed, block-based implementation of
FileSystem that uses Amazon S3
as a backing store. |
| org.apache.hadoop.fs.s3native |
A distributed implementation of
FileSystem for reading and writing files on
Amazon S3. |
| org.apache.hadoop.hdfs |
A distributed implementation of
FileSystem. |
| org.apache.hadoop.hdfs.web | |
| org.apache.hadoop.mapred |
A software framework for easily writing applications which process vast
amounts of data (multi-terabyte data-sets) parallelly on large clusters
(thousands of nodes) built of commodity hardware in a reliable, fault-tolerant
manner.
|
| org.apache.hadoop.mapreduce.lib.input | |
| org.apache.hadoop.tools.distcp2.mapred | |
| org.apache.hadoop.tools.distcp2.util |
| 限定符和类型 | 方法和说明 |
|---|---|
static FileStatus |
DistributedCache.getFileStatus(Configuration conf,
URI cache)
Returns
FileStatus of a given cache file on hdfs. |
| 限定符和类型 | 方法和说明 |
|---|---|
FileStatus |
RawLocalFileSystem.getFileStatus(Path f) |
FileStatus |
HarFileSystem.getFileStatus(Path f)
return the filestatus of files in har archive.
|
FileStatus |
FilterFileSystem.getFileStatus(Path f)
Get file status.
|
abstract FileStatus |
FileSystem.getFileStatus(Path f)
Return a file status object that represents the path.
|
FileStatus[] |
FileSystem.globStatus(Path pathPattern)
Return all the files that match filePattern and are not checksum
files.
|
FileStatus[] |
FileSystem.globStatus(Path pathPattern,
PathFilter filter)
Return an array of FileStatus objects whose path names match pathPattern
and is accepted by the user-supplied path filter.
|
FileStatus[] |
RawLocalFileSystem.listStatus(Path f) |
FileStatus[] |
HarFileSystem.listStatus(Path f)
liststatus returns the children of a directory
after looking up the index files.
|
FileStatus[] |
FilterFileSystem.listStatus(Path f)
List files in a directory.
|
abstract FileStatus[] |
FileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
FileStatus[] |
ChecksumFileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
FileStatus[] |
FileSystem.listStatus(Path[] files)
Filter files/directories in the given list of paths using default
path filter.
|
FileStatus[] |
FileSystem.listStatus(Path[] files,
PathFilter filter)
Filter files/directories in the given list of paths using user-supplied
path filter.
|
FileStatus[] |
FileSystem.listStatus(Path f,
PathFilter filter)
Filter files/directories in the given path using the user-supplied path
filter.
|
| 限定符和类型 | 方法和说明 |
|---|---|
BlockLocation[] |
HarFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len)
Get block locations from the underlying fs and fix their
offsets and lengths.
|
BlockLocation[] |
FilterFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len) |
BlockLocation[] |
FileSystem.getFileBlockLocations(FileStatus file,
long start,
long len)
Return an array containing hostnames, offset and size of
portions of the given file.
|
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats)
convert an array of FileStatus to an array of Path
|
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats,
Path path)
convert an array of FileStatus to an array of Path.
|
| 限定符和类型 | 方法和说明 |
|---|---|
FileStatus |
FTPFileSystem.getFileStatus(Path file) |
FileStatus[] |
FTPFileSystem.listStatus(Path file) |
| 限定符和类型 | 方法和说明 |
|---|---|
FileStatus |
KosmosFileSystem.getFileStatus(Path path) |
FileStatus[] |
KosmosFileSystem.listStatus(Path path) |
| 限定符和类型 | 方法和说明 |
|---|---|
BlockLocation[] |
KosmosFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len)
Return null if the file doesn't exist; otherwise, get the
locations of the various chunks of the file file from KFS.
|
| 限定符和类型 | 方法和说明 |
|---|---|
short |
ChmodParser.applyNewPermission(FileStatus file)
Apply permission against specified file and determine what the
new mode would be
|
| 限定符和类型 | 方法和说明 |
|---|---|
FileStatus |
S3FileSystem.getFileStatus(Path f)
FileStatus for S3 file systems.
|
FileStatus[] |
S3FileSystem.listStatus(Path f) |
| 限定符和类型 | 方法和说明 |
|---|---|
FileStatus |
NativeS3FileSystem.getFileStatus(Path f) |
FileStatus[] |
NativeS3FileSystem.listStatus(Path f)
If
f is a file, this method will make a single call to S3. |
| 限定符和类型 | 方法和说明 |
|---|---|
FileStatus |
HftpFileSystem.getFileStatus(Path f) |
FileStatus |
DistributedFileSystem.getFileStatus(Path f)
Returns the stat information about the file.
|
FileStatus |
ChecksumDistributedFileSystem.getFileStatus(Path f)
Returns the stat information about the file.
|
FileStatus[] |
HftpFileSystem.listStatus(Path f) |
FileStatus[] |
DistributedFileSystem.listStatus(Path p)
List all the entries of a directory
Note that this operation is not atomic for a large directory.
|
| 限定符和类型 | 方法和说明 |
|---|---|
BlockLocation[] |
DistributedFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len) |
| 限定符和类型 | 方法和说明 |
|---|---|
FileStatus |
WebHdfsFileSystem.getFileStatus(Path f) |
FileStatus[] |
WebHdfsFileSystem.listStatus(Path f) |
| 限定符和类型 | 方法和说明 |
|---|---|
BlockLocation[] |
WebHdfsFileSystem.getFileBlockLocations(FileStatus status,
long offset,
long length) |
| 限定符和类型 | 方法和说明 |
|---|---|
protected FileStatus[] |
SequenceFileInputFormat.listStatus(JobConf job) |
protected FileStatus[] |
FileInputFormat.listStatus(JobConf job)
List input directories.
|
| 限定符和类型 | 方法和说明 |
|---|---|
protected List<FileStatus> |
SequenceFileInputFormat.listStatus(JobContext job) |
protected List<FileStatus> |
FileInputFormat.listStatus(JobContext job)
List input directories.
|
| 限定符和类型 | 方法和说明 |
|---|---|
protected BlockLocation[] |
CombineFileInputFormat.getFileBlockLocations(FileSystem fs,
FileStatus stat) |
static List<FileSplit> |
NLineInputFormat.getSplitsForFile(FileStatus status,
Configuration conf,
int numLinesPerSplit) |
| 限定符和类型 | 方法和说明 |
|---|---|
RecordReader<Text,FileStatus> |
UniformSizeInputFormat.createRecordReader(InputSplit split,
TaskAttemptContext context)
Implementation of InputFormat::createRecordReader().
|
| 限定符和类型 | 方法和说明 |
|---|---|
void |
CopyMapper.map(Text relPath,
FileStatus sourceFileStatus,
Mapper.Context context)
Implementation of the Mapper<>::map().
|
| 限定符和类型 | 方法和说明 |
|---|---|
static void |
DistCpUtils.preserve(FileSystem targetFS,
Path path,
FileStatus srcFileStatus,
EnumSet<DistCpOptions.FileAttribute> attributes)
Preserve attribute on file matching that of the file status being sent
as argument.
|
Copyright © 2009 The Apache Software Foundation