程序包 | 说明 |
---|---|
org.apache.hadoop.contrib.index.example | |
org.apache.hadoop.examples |
Hadoop example code.
|
org.apache.hadoop.examples.terasort |
This package consists of 3 map/reduce applications for Hadoop to
compete in the annual terabyte sort
competition.
|
org.apache.hadoop.mapred |
A software framework for easily writing applications which process vast
amounts of data (multi-terabyte data-sets) parallelly on large clusters
(thousands of nodes) built of commodity hardware in a reliable, fault-tolerant
manner.
|
org.apache.hadoop.mapred.lib |
Library of generally useful mappers, reducers, and partitioners.
|
org.apache.hadoop.streaming |
Hadoop Streaming is a utility which allows users to create and run
Map-Reduce jobs with any executables (e.g.
|
限定符和类型 | 类和说明 |
---|---|
class |
LineDocInputFormat
An InputFormat for LineDoc for plain text files where each line is a doc.
|
限定符和类型 | 类和说明 |
---|---|
static class |
MultiFileWordCount.MyInputFormat
To use
MultiFileInputFormat , one should extend it, to return a
(custom) RecordReader . |
限定符和类型 | 类和说明 |
---|---|
class |
TeraInputFormat
An input format that reads the first 10 characters of each line as the key
and the rest of the line as the value.
|
限定符和类型 | 类和说明 |
---|---|
class |
KeyValueTextInputFormat
An
InputFormat for plain text files. |
class |
MultiFileInputFormat<K,V>
已过时。
Use
CombineFileInputFormat instead |
class |
SequenceFileAsBinaryInputFormat
InputFormat reading keys, values from SequenceFiles in binary (raw)
format.
|
class |
SequenceFileAsTextInputFormat
This class is similar to SequenceFileInputFormat, except it generates SequenceFileAsTextRecordReader
which converts the input keys and values to their String forms by calling toString() method.
|
class |
SequenceFileInputFilter<K,V>
A class that allows a map/red job to work on a sample of sequence files.
|
class |
SequenceFileInputFormat<K,V>
An
InputFormat for SequenceFile s. |
class |
TextInputFormat
An
InputFormat for plain text files. |
限定符和类型 | 类和说明 |
---|---|
class |
CombineFileInputFormat<K,V>
An abstract
InputFormat that returns CombineFileSplit 's
in InputFormat.getSplits(JobConf, int) method. |
class |
NLineInputFormat
NLineInputFormat which splits N lines of input as one split.
|
限定符和类型 | 类和说明 |
---|---|
class |
AutoInputFormat
An
InputFormat that tries to deduce the types of the input files
automatically. |
class |
StreamInputFormat
An input format that selects a RecordReader based on a JobConf property.
|
Copyright © 2009 The Apache Software Foundation