org.apache.hadoop.mapred

类 TextInputFormat

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat<LongWritable,Text>

org.apache.hadoop.mapred.TextInputFormat

所有已实现的接口:

InputFormat<LongWritable,Text>, JobConfigurable

public class TextInputFormat
extends FileInputFormat<LongWritable,Text>
implements JobConfigurable

An InputFormat for plain text files. Files are broken into lines. Either linefeed or carriage-return are used to signal end of line. Keys are the position in the file, and values are the line of text..

嵌套类概要

从类继承的嵌套类/接口 org.apache.hadoop.mapred.FileInputFormat

FileInputFormat.Counter

字段概要

从类继承的字段 org.apache.hadoop.mapred.FileInputFormat

LOG

构造器概要

构造器

构造器和说明
TextInputFormat()

方法概要

方法

限定符和类型	方法和说明
void	configure(JobConf conf) Initializes a new instance from a JobConf.
RecordReader<LongWritable,Text>	getRecordReader(InputSplit genericSplit, JobConf job, Reporter reporter) Get the RecordReader for the given InputSplit.
protected boolean	isSplitable(FileSystem fs, Path file) Is the given filename splitable?

从类继承的方法 org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

TextInputFormat

public TextInputFormat()

方法详细资料

configure

public void configure(JobConf conf)

从接口复制的说明: JobConfigurable

Initializes a new instance from a JobConf.

指定者:

configure 在接口中 JobConfigurable

参数:

conf - the configuration

isSplitable

protected boolean isSplitable(FileSystem fs,
                  Path file)

从类复制的说明: FileInputFormat

Is the given filename splitable? Usually, true, but if the file is stream compressed, it will not be. FileInputFormat implementations can override this and return false to ensure that individual input files are never split-up so that Mappers process entire files.

覆盖:

isSplitable 在类中 FileInputFormat<LongWritable,Text>

参数:

fs - the file system that the file is on

file - the file name to check

返回:

is this file splitable?

getRecordReader

public RecordReader<LongWritable,Text> getRecordReader(InputSplit genericSplit,
                                              JobConf job,
                                              Reporter reporter)
                                                throws IOException

从接口复制的说明: InputFormat

Get the RecordReader for the given InputSplit.

It is the responsibility of the RecordReader to respect record boundaries while processing the logical split to present a record-oriented view to the individual task.

指定者:

getRecordReader 在接口中 InputFormat<LongWritable,Text>

指定者:

getRecordReader 在类中 FileInputFormat<LongWritable,Text>

参数:

genericSplit - the InputSplit

job - the job that this split belongs to

返回:

a RecordReader

抛出:

IOException