程序包 | 说明 |
---|---|
org.apache.hadoop.fs |
An abstract file system API.
|
org.apache.hadoop.mapred |
A software framework for easily writing applications which process vast
amounts of data (multi-terabyte data-sets) parallelly on large clusters
(thousands of nodes) built of commodity hardware in a reliable, fault-tolerant
manner.
|
org.apache.hadoop.mapred.lib |
Library of generally useful mappers, reducers, and partitioners.
|
org.apache.hadoop.mapreduce.lib.input |
限定符和类型 | 方法和说明 |
---|---|
Path[] |
InMemoryFileSystem.getFiles(PathFilter filter)
已过时。
|
int |
InMemoryFileSystem.getNumFiles(PathFilter filter)
已过时。
|
FileStatus[] |
FileSystem.globStatus(Path pathPattern,
PathFilter filter)
Return an array of FileStatus objects whose path names match pathPattern
and is accepted by the user-supplied path filter.
|
FileStatus[] |
FileSystem.listStatus(Path[] files,
PathFilter filter)
Filter files/directories in the given list of paths using user-supplied
path filter.
|
FileStatus[] |
FileSystem.listStatus(Path f,
PathFilter filter)
Filter files/directories in the given path using the user-supplied path
filter.
|
限定符和类型 | 类和说明 |
---|---|
class |
OutputLogFilter
已过时。
Use
Utils.OutputFileUtils.OutputLogFilter
instead. |
static class |
Utils.OutputFileUtils.OutputFilesFilter
This class filters output(part) files from the given directory
It does not accept files with filenames _logs and _SUCCESS.
|
static class |
Utils.OutputFileUtils.OutputLogFilter
This class filters log files from directory given
It doesnt accept paths having _logs.
|
限定符和类型 | 方法和说明 |
---|---|
static PathFilter |
FileInputFormat.getInputPathFilter(JobConf conf)
Get a PathFilter instance of the filter set for the input paths.
|
限定符和类型 | 方法和说明 |
---|---|
static void |
FileInputFormat.setInputPathFilter(JobConf conf,
Class<? extends PathFilter> filter)
Set a PathFilter to be applied to the input paths for the map-reduce job.
|
限定符和类型 | 方法和说明 |
---|---|
protected void |
CombineFileInputFormat.createPool(JobConf conf,
PathFilter... filters)
Create a new pool and add the filters to it.
|
限定符和类型 | 方法和说明 |
---|---|
protected void |
CombineFileInputFormat.createPool(JobConf conf,
List<PathFilter> filters)
Create a new pool and add the filters to it.
|
限定符和类型 | 方法和说明 |
---|---|
static PathFilter |
FileInputFormat.getInputPathFilter(JobContext context)
Get a PathFilter instance of the filter set for the input paths.
|
限定符和类型 | 方法和说明 |
---|---|
protected void |
CombineFileInputFormat.createPool(PathFilter... filters)
Create a new pool and add the filters to it.
|
限定符和类型 | 方法和说明 |
---|---|
protected void |
CombineFileInputFormat.createPool(List<PathFilter> filters)
Create a new pool and add the filters to it.
|
static void |
FileInputFormat.setInputPathFilter(Job job,
Class<? extends PathFilter> filter)
Set a PathFilter to be applied to the input paths for the map-reduce job.
|
Copyright © 2009 The Apache Software Foundation