程序包 | 说明 |
---|---|
org.apache.hadoop.fs |
An abstract file system API.
|
org.apache.hadoop.fs.kfs |
A client for the Kosmos filesystem (KFS)
Introduction
This pages describes how to use Kosmos Filesystem
( KFS ) as a backing
store with Hadoop.
|
org.apache.hadoop.hdfs |
A distributed implementation of
FileSystem . |
org.apache.hadoop.hdfs.web | |
org.apache.hadoop.mapred |
A software framework for easily writing applications which process vast
amounts of data (multi-terabyte data-sets) parallelly on large clusters
(thousands of nodes) built of commodity hardware in a reliable, fault-tolerant
manner.
|
org.apache.hadoop.mapreduce.lib.input |
限定符和类型 | 方法和说明 |
---|---|
BlockLocation[] |
HarFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len)
Get block locations from the underlying fs and fix their
offsets and lengths.
|
BlockLocation[] |
FilterFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len) |
BlockLocation[] |
FileSystem.getFileBlockLocations(FileStatus file,
long start,
long len)
Return an array containing hostnames, offset and size of
portions of the given file.
|
限定符和类型 | 方法和说明 |
---|---|
BlockLocation[] |
KosmosFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len)
Return null if the file doesn't exist; otherwise, get the
locations of the various chunks of the file file from KFS.
|
限定符和类型 | 方法和说明 |
---|---|
BlockLocation[] |
DFSClient.getBlockLocations(String src,
long start,
long length)
Get block location info about file
getBlockLocations() returns a list of hostnames that store
data for a specific file region.
|
BlockLocation[] |
DistributedFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len) |
static BlockLocation[] |
DFSUtil.locatedBlocks2Locations(LocatedBlocks blocks)
Convert a LocatedBlocks to BlockLocations[]
|
限定符和类型 | 方法和说明 |
---|---|
BlockLocation[] |
WebHdfsFileSystem.getFileBlockLocations(FileStatus status,
long offset,
long length) |
限定符和类型 | 方法和说明 |
---|---|
protected int |
FileInputFormat.getBlockIndex(BlockLocation[] blkLocations,
long offset) |
protected String[] |
FileInputFormat.getSplitHosts(BlockLocation[] blkLocations,
long offset,
long splitSize,
NetworkTopology clusterMap)
This function identifies and returns the hosts that contribute
most for a given split.
|
限定符和类型 | 方法和说明 |
---|---|
protected BlockLocation[] |
CombineFileInputFormat.getFileBlockLocations(FileSystem fs,
FileStatus stat) |
限定符和类型 | 方法和说明 |
---|---|
protected int |
FileInputFormat.getBlockIndex(BlockLocation[] blkLocations,
long offset) |
Copyright © 2009 The Apache Software Foundation