类 org.apache.hadoop.mapreduce.InputSplit
的使用

使用InputSplit的程序包

程序包	说明
org.apache.hadoop.mapred	A software framework for easily writing applications which process vast amounts of data (multi-terabyte data-sets) parallelly on large clusters (thousands of nodes) built of commodity hardware in a reliable, fault-tolerant manner.
org.apache.hadoop.mapreduce
org.apache.hadoop.mapreduce.lib.db
org.apache.hadoop.mapreduce.lib.input
org.apache.hadoop.mapreduce.split
org.apache.hadoop.tools.distcp2.mapred
org.apache.hadoop.tools.distcp2.mapred.lib
org.apache.hadoop.tools.rumen	Rumen is a data extraction and analysis tool built for Apache Hadoop.

org.apache.hadoop.mapred中InputSplit的使用

org.apache.hadoop.mapred中InputSplit的子类

限定符和类型	类和说明
class	FileSplit A section of an input file.

org.apache.hadoop.mapreduce中InputSplit的使用

返回InputSplit的org.apache.hadoop.mapreduce中的方法

限定符和类型	方法和说明
InputSplit	MapContext.getInputSplit() Get the input split for this map.

返回变量类型为InputSplit的类型的org.apache.hadoop.mapreduce中的方法

限定符和类型	方法和说明
abstract List<InputSplit>	InputFormat.getSplits(JobContext context) Logically split the set of input files for the job.

参数类型为InputSplit的org.apache.hadoop.mapreduce中的方法

限定符和类型	方法和说明
abstract RecordReader<K,V>	InputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) Create a record reader for a given split.
abstract void	RecordReader.initialize(InputSplit split, TaskAttemptContext context) Called once at initialization.

参数类型为InputSplit的org.apache.hadoop.mapreduce中的构造器

构造器和说明
MapContext(Configuration conf, TaskAttemptID taskid, RecordReader<KEYIN,VALUEIN> reader, RecordWriter<KEYOUT,VALUEOUT> writer, OutputCommitter committer, StatusReporter reporter, InputSplit split)
Mapper.Context(Configuration conf, TaskAttemptID taskid, RecordReader<KEYIN,VALUEIN> reader, RecordWriter<KEYOUT,VALUEOUT> writer, OutputCommitter committer, StatusReporter reporter, InputSplit split)

org.apache.hadoop.mapreduce.lib.db中InputSplit的使用

org.apache.hadoop.mapreduce.lib.db中InputSplit的子类

限定符和类型	类和说明
static class	DataDrivenDBInputFormat.DataDrivenDBInputSplit A InputSplit that spans a set of rows
static class	DBInputFormat.DBInputSplit A InputSplit that spans a set of rows

返回变量类型为InputSplit的类型的org.apache.hadoop.mapreduce.lib.db中的方法

限定符和类型	方法和说明
List<InputSplit>	DBInputFormat.getSplits(JobContext job) Logically split the set of input files for the job.
List<InputSplit>	DataDrivenDBInputFormat.getSplits(JobContext job) Logically split the set of input files for the job.
List<InputSplit>	TextSplitter.split(Configuration conf, ResultSet results, String colName) This method needs to determine the splits between two user-provided strings.
List<InputSplit>	IntegerSplitter.split(Configuration conf, ResultSet results, String colName)
List<InputSplit>	FloatSplitter.split(Configuration conf, ResultSet results, String colName)
List<InputSplit>	DBSplitter.split(Configuration conf, ResultSet results, String colName) Given a ResultSet containing one record (and already advanced to that record) with two columns (a low value, and a high value, both of the same type), determine a set of splits that span the given values.
List<InputSplit>	DateSplitter.split(Configuration conf, ResultSet results, String colName)
List<InputSplit>	BooleanSplitter.split(Configuration conf, ResultSet results, String colName)
List<InputSplit>	BigDecimalSplitter.split(Configuration conf, ResultSet results, String colName)

参数类型为InputSplit的org.apache.hadoop.mapreduce.lib.db中的方法

限定符和类型	方法和说明
RecordReader<LongWritable,T>	DBInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) Create a record reader for a given split.
void	DBRecordReader.initialize(InputSplit split, TaskAttemptContext context)

org.apache.hadoop.mapreduce.lib.input中InputSplit的使用

org.apache.hadoop.mapreduce.lib.input中InputSplit的子类

限定符和类型	类和说明
class	CombineFileSplit A sub-collection of input files.

返回变量类型为InputSplit的类型的org.apache.hadoop.mapreduce.lib.input中的方法

限定符和类型	方法和说明
List<InputSplit>	NLineInputFormat.getSplits(JobContext job) Logically splits the set of input files for the job, splits N lines of the input as one split.
List<InputSplit>	FileInputFormat.getSplits(JobContext job) Generate the list of files and make them into FileSplits.
List<InputSplit>	DelegatingInputFormat.getSplits(JobContext job)
List<InputSplit>	CombineFileInputFormat.getSplits(JobContext job)

参数类型为InputSplit的org.apache.hadoop.mapreduce.lib.input中的方法

限定符和类型	方法和说明
RecordReader<LongWritable,Text>	TextInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context)
RecordReader<K,V>	SequenceFileInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context)
RecordReader<K,V>	SequenceFileInputFilter.createRecordReader(InputSplit split, TaskAttemptContext context) Create a record reader for the given split
RecordReader<Text,Text>	SequenceFileAsTextInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context)
RecordReader<BytesWritable,BytesWritable>	SequenceFileAsBinaryInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context)
RecordReader<LongWritable,Text>	NLineInputFormat.createRecordReader(InputSplit genericSplit, TaskAttemptContext context)
RecordReader<Text,Text>	KeyValueTextInputFormat.createRecordReader(InputSplit genericSplit, TaskAttemptContext context)
RecordReader<K,V>	DelegatingInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context)
abstract RecordReader<K,V>	CombineFileInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) This is not implemented yet.
void	SequenceFileRecordReader.initialize(InputSplit split, TaskAttemptContext context)
void	SequenceFileAsTextRecordReader.initialize(InputSplit split, TaskAttemptContext context)
void	SequenceFileAsBinaryInputFormat.SequenceFileAsBinaryRecordReader.initialize(InputSplit split, TaskAttemptContext context)
void	LineRecordReader.initialize(InputSplit genericSplit, TaskAttemptContext context)
void	KeyValueLineRecordReader.initialize(InputSplit genericSplit, TaskAttemptContext context)
void	DelegatingRecordReader.initialize(InputSplit split, TaskAttemptContext context)
void	CombineFileRecordReader.initialize(InputSplit split, TaskAttemptContext context)

参数类型为InputSplit的org.apache.hadoop.mapreduce.lib.input中的构造器

构造器和说明
DelegatingRecordReader(InputSplit split, TaskAttemptContext context) Constructs the DelegatingRecordReader.

org.apache.hadoop.mapreduce.split中InputSplit的使用

类型参数类型为InputSplit的org.apache.hadoop.mapreduce.split中的方法

限定符和类型	方法和说明
static <T extends InputSplit> void	JobSplitWriter.createSplitFiles(Path jobSubmitDir, Configuration conf, FileSystem fs, List<InputSplit> splits)
static <T extends InputSplit> void	JobSplitWriter.createSplitFiles(Path jobSubmitDir, Configuration conf, FileSystem fs, T[] splits)

参数类型为InputSplit的org.apache.hadoop.mapreduce.split中的方法

限定符和类型	方法和说明
static <T extends InputSplit> void	JobSplitWriter.createSplitFiles(Path jobSubmitDir, Configuration conf, FileSystem fs, T[] splits)

类型变量类型为InputSplit的org.apache.hadoop.mapreduce.split中的方法参数

限定符和类型	方法和说明
static <T extends InputSplit> void	JobSplitWriter.createSplitFiles(Path jobSubmitDir, Configuration conf, FileSystem fs, List<InputSplit> splits)

参数类型为InputSplit的org.apache.hadoop.mapreduce.split中的构造器

构造器和说明
JobSplit.SplitMetaInfo(InputSplit split, long startOffset)
JobSplit.TaskSplitMetaInfo(InputSplit split, long startOffset)

org.apache.hadoop.tools.distcp2.mapred中InputSplit的使用

返回变量类型为InputSplit的类型的org.apache.hadoop.tools.distcp2.mapred中的方法

限定符和类型	方法和说明
List<InputSplit>	UniformSizeInputFormat.getSplits(JobContext context) Implementation of InputFormat::getSplits().

参数类型为InputSplit的org.apache.hadoop.tools.distcp2.mapred中的方法

限定符和类型	方法和说明
RecordReader<Text,FileStatus>	UniformSizeInputFormat.createRecordReader(InputSplit split, TaskAttemptContext context) Implementation of InputFormat::createRecordReader().

org.apache.hadoop.tools.distcp2.mapred.lib中InputSplit的使用

返回变量类型为InputSplit的类型的org.apache.hadoop.tools.distcp2.mapred.lib中的方法

限定符和类型	方法和说明
List<InputSplit>	DynamicInputFormat.getSplits(JobContext jobContext) Implementation of InputFormat::getSplits().

参数类型为InputSplit的org.apache.hadoop.tools.distcp2.mapred.lib中的方法

限定符和类型	方法和说明
RecordReader<K,V>	DynamicInputFormat.createRecordReader(InputSplit inputSplit, TaskAttemptContext taskAttemptContext) Implementation of Inputformat::createRecordReader().
void	DynamicRecordReader.initialize(InputSplit inputSplit, TaskAttemptContext taskAttemptContext) Implementation for RecordReader::initialize().

org.apache.hadoop.tools.rumen中InputSplit的使用

返回InputSplit的org.apache.hadoop.tools.rumen中的方法

限定符和类型	方法和说明
InputSplit[]	ZombieJob.getInputSplits()
InputSplit[]	JobStory.getInputSplits() Get the input splits for the job.