CombineFileInputFormat
instead@Deprecated public abstract class MultiFileInputFormat<K,V> extends FileInputFormat<K,V>
InputFormat
that returns MultiFileSplit
's
in getSplits(JobConf, int)
method. Splits are constructed from
the files under the input paths. Each split returned contains nearly
equal content length. getRecordReader(InputSplit, JobConf, Reporter)
to construct RecordReader
's for MultiFileSplit
's.MultiFileSplit
FileInputFormat.Counter
LOG
构造器和说明 |
---|
MultiFileInputFormat()
已过时。
|
限定符和类型 | 方法和说明 |
---|---|
abstract RecordReader<K,V> |
getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
已过时。
Get the
RecordReader for the given InputSplit . |
InputSplit[] |
getSplits(JobConf job,
int numSplits)
已过时。
Splits files returned by
FileInputFormat.listStatus(JobConf) when
they're too big. |
addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, isSplitable, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize
public InputSplit[] getSplits(JobConf job, int numSplits) throws IOException
FileInputFormat
FileInputFormat.listStatus(JobConf)
when
they're too big.getSplits
在接口中 InputFormat<K,V>
getSplits
在类中 FileInputFormat<K,V>
job
- job configuration.numSplits
- the desired number of splits, a hint.InputSplit
s for the job.IOException
public abstract RecordReader<K,V> getRecordReader(InputSplit split, JobConf job, Reporter reporter) throws IOException
InputFormat
RecordReader
for the given InputSplit
.
It is the responsibility of the RecordReader
to respect
record boundaries while processing the logical split to present a
record-oriented view to the individual task.
getRecordReader
在接口中 InputFormat<K,V>
getRecordReader
在类中 FileInputFormat<K,V>
split
- the InputSplit
job
- the job that this split belongs toRecordReader
IOException
Copyright © 2009 The Apache Software Foundation