接口 org.apache.hadoop.mapred.InputSplit
的使用

使用InputSplit的程序包

程序包	说明
org.apache.hadoop.contrib.index.example
org.apache.hadoop.examples	Hadoop example code.
org.apache.hadoop.examples.terasort	This package consists of 3 map/reduce applications for Hadoop to compete in the annual terabyte sort competition.
org.apache.hadoop.mapred	A software framework for easily writing applications which process vast amounts of data (multi-terabyte data-sets) parallelly on large clusters (thousands of nodes) built of commodity hardware in a reliable, fault-tolerant manner.
org.apache.hadoop.mapred.join	Given a set of sorted datasets keyed with the same class and yielding equal partitions, it is possible to effect a join of those datasets prior to the map.
org.apache.hadoop.mapred.lib	Library of generally useful mappers, reducers, and partitioners.
org.apache.hadoop.mapred.lib.db	org.apache.hadoop.mapred.lib.db Package This package contains a library to read records from a database as an input to a mapreduce job, and write the output records to the database.
org.apache.hadoop.mapreduce.split
org.apache.hadoop.streaming	Hadoop Streaming is a utility which allows users to create and run Map-Reduce jobs with any executables (e.g.

org.apache.hadoop.contrib.index.example中InputSplit的使用

参数类型为InputSplit的org.apache.hadoop.contrib.index.example中的方法

限定符和类型	方法和说明
RecordReader<DocumentID,LineDocTextAndOp>	LineDocInputFormat.getRecordReader(InputSplit split, JobConf job, Reporter reporter)

org.apache.hadoop.examples中InputSplit的使用

实现InputSplit的org.apache.hadoop.examples中的类

限定符和类型	类和说明
static class	SleepJob.EmptySplit

返回InputSplit的org.apache.hadoop.examples中的方法

限定符和类型	方法和说明
InputSplit[]	SleepJob.SleepInputFormat.getSplits(JobConf conf, int numSplits)

参数类型为InputSplit的org.apache.hadoop.examples中的方法

限定符和类型	方法和说明
RecordReader<IntWritable,IntWritable>	SleepJob.SleepInputFormat.getRecordReader(InputSplit ignored, JobConf conf, Reporter reporter)
RecordReader<MultiFileWordCount.WordOffset,Text>	MultiFileWordCount.MyInputFormat.getRecordReader(InputSplit split, JobConf job, Reporter reporter)

org.apache.hadoop.examples.terasort中InputSplit的使用

返回InputSplit的org.apache.hadoop.examples.terasort中的方法

限定符和类型	方法和说明
InputSplit[]	TeraInputFormat.getSplits(JobConf conf, int splits)

参数类型为InputSplit的org.apache.hadoop.examples.terasort中的方法

限定符和类型	方法和说明
RecordReader<Text,Text>	TeraInputFormat.getRecordReader(InputSplit split, JobConf job, Reporter reporter)

org.apache.hadoop.mapred中InputSplit的使用

实现InputSplit的org.apache.hadoop.mapred中的类

限定符和类型	类和说明
class	FileSplit A section of an input file.
class	MultiFileSplit 已过时。 Use CombineFileSplit instead

返回InputSplit的org.apache.hadoop.mapred中的方法

限定符和类型	方法和说明
InputSplit	Task.TaskReporter.getInputSplit()
InputSplit	Reporter.getInputSplit() Get the InputSplit object for a map.
InputSplit[]	MultiFileInputFormat.getSplits(JobConf job, int numSplits) 已过时。
InputSplit[]	InputFormat.getSplits(JobConf job, int numSplits) Logically split the set of input files for the job.
InputSplit[]	FileInputFormat.getSplits(JobConf job, int numSplits) Splits files returned by FileInputFormat.listStatus(JobConf) when they're too big.

参数类型为InputSplit的org.apache.hadoop.mapred中的方法

限定符和类型	方法和说明
RecordReader<LongWritable,Text>	TextInputFormat.getRecordReader(InputSplit genericSplit, JobConf job, Reporter reporter)
RecordReader<K,V>	SequenceFileInputFormat.getRecordReader(InputSplit split, JobConf job, Reporter reporter)
RecordReader<K,V>	SequenceFileInputFilter.getRecordReader(InputSplit split, JobConf job, Reporter reporter) Create a record reader for the given split
RecordReader<Text,Text>	SequenceFileAsTextInputFormat.getRecordReader(InputSplit split, JobConf job, Reporter reporter)
RecordReader<BytesWritable,BytesWritable>	SequenceFileAsBinaryInputFormat.getRecordReader(InputSplit split, JobConf job, Reporter reporter)
abstract RecordReader<K,V>	MultiFileInputFormat.getRecordReader(InputSplit split, JobConf job, Reporter reporter) 已过时。
RecordReader<Text,Text>	KeyValueTextInputFormat.getRecordReader(InputSplit genericSplit, JobConf job, Reporter reporter)
RecordReader<K,V>	InputFormat.getRecordReader(InputSplit split, JobConf job, Reporter reporter) Get the RecordReader for the given InputSplit.
abstract RecordReader<K,V>	FileInputFormat.getRecordReader(InputSplit split, JobConf job, Reporter reporter)
void	Task.TaskReporter.setInputSplit(InputSplit split)

org.apache.hadoop.mapred.join中InputSplit的使用

实现InputSplit的org.apache.hadoop.mapred.join中的类

限定符和类型	类和说明
class	CompositeInputSplit This InputSplit contains a set of child InputSplits.

返回InputSplit的org.apache.hadoop.mapred.join中的方法

限定符和类型	方法和说明
InputSplit	CompositeInputSplit.get(int i) Get ith child InputSplit.
InputSplit[]	CompositeInputFormat.getSplits(JobConf job, int numSplits) Build a CompositeInputSplit from the child InputFormats by assigning the ith split from each child to the ith composite split.

参数类型为InputSplit的org.apache.hadoop.mapred.join中的方法

限定符和类型	方法和说明
void	CompositeInputSplit.add(InputSplit s) Add an InputSplit to this collection.
ComposableRecordReader<K,TupleWritable>	CompositeInputFormat.getRecordReader(InputSplit split, JobConf job, Reporter reporter) Construct a CompositeRecordReader for the children of this InputFormat as defined in the init expression.
ComposableRecordReader<K,V>	ComposableInputFormat.getRecordReader(InputSplit split, JobConf job, Reporter reporter)

org.apache.hadoop.mapred.lib中InputSplit的使用

实现InputSplit的org.apache.hadoop.mapred.lib中的类

限定符和类型	类和说明
class	CombineFileSplit A sub-collection of input files.

返回InputSplit的org.apache.hadoop.mapred.lib中的方法

限定符和类型	方法和说明
InputSplit[]	NLineInputFormat.getSplits(JobConf job, int numSplits) Logically splits the set of input files for the job, splits N lines of the input as one split.
InputSplit[]	DelegatingInputFormat.getSplits(JobConf conf, int numSplits)
InputSplit[]	CombineFileInputFormat.getSplits(JobConf job, int numSplits)

参数类型为InputSplit的org.apache.hadoop.mapred.lib中的方法

限定符和类型	方法和说明
RecordReader<LongWritable,Text>	NLineInputFormat.getRecordReader(InputSplit genericSplit, JobConf job, Reporter reporter)
RecordReader<K,V>	DelegatingInputFormat.getRecordReader(InputSplit split, JobConf conf, Reporter reporter)
abstract RecordReader<K,V>	CombineFileInputFormat.getRecordReader(InputSplit split, JobConf job, Reporter reporter) This is not implemented yet.

org.apache.hadoop.mapred.lib.db中InputSplit的使用

实现InputSplit的org.apache.hadoop.mapred.lib.db中的类

限定符和类型	类和说明
protected static class	DBInputFormat.DBInputSplit A InputSplit that spans a set of rows

返回InputSplit的org.apache.hadoop.mapred.lib.db中的方法

限定符和类型	方法和说明
InputSplit[]	DBInputFormat.getSplits(JobConf job, int chunks) Logically split the set of input files for the job.

参数类型为InputSplit的org.apache.hadoop.mapred.lib.db中的方法

限定符和类型	方法和说明
RecordReader<LongWritable,T>	DBInputFormat.getRecordReader(InputSplit split, JobConf job, Reporter reporter) Get the RecordReader for the given InputSplit.

org.apache.hadoop.mapreduce.split中InputSplit的使用

参数类型为InputSplit的org.apache.hadoop.mapreduce.split中的方法

限定符和类型	方法和说明
static void	JobSplitWriter.createSplitFiles(Path jobSubmitDir, Configuration conf, FileSystem fs, InputSplit[] splits)

org.apache.hadoop.streaming中InputSplit的使用

参数类型为InputSplit的org.apache.hadoop.streaming中的方法

限定符和类型	方法和说明
RecordReader<Text,Text>	StreamInputFormat.getRecordReader(InputSplit genericSplit, JobConf job, Reporter reporter)
RecordReader	AutoInputFormat.getRecordReader(InputSplit split, JobConf job, Reporter reporter)