org.apache.hadoop.mapred

类 SequenceFileInputFilter<K,V>

java.lang.Object

org.apache.hadoop.mapred.FileInputFormat<K,V>

org.apache.hadoop.mapred.SequenceFileInputFormat<K,V>

org.apache.hadoop.mapred.SequenceFileInputFilter<K,V>

所有已实现的接口:

InputFormat<K,V>

public class SequenceFileInputFilter<K,V>
extends SequenceFileInputFormat<K,V>

A class that allows a map/red job to work on a sample of sequence files. The sample is decided by the filter class set by the job.

嵌套类概要

嵌套类

限定符和类型	类和说明
static interface	SequenceFileInputFilter.Filter filter interface
static class	SequenceFileInputFilter.FilterBase base class for Filters
static class	SequenceFileInputFilter.MD5Filter This class returns a set of records by examing the MD5 digest of its key against a filtering frequency f.
static class	SequenceFileInputFilter.PercentFilter This class returns a percentage of records The percentage is determined by a filtering frequency f using the criteria record# % f == 0.
static class	SequenceFileInputFilter.RegexFilter Records filter by matching key to regex

从类继承的嵌套类/接口 org.apache.hadoop.mapred.FileInputFormat

FileInputFormat.Counter

字段概要

从类继承的字段 org.apache.hadoop.mapred.FileInputFormat

LOG

构造器概要

构造器

构造器和说明
SequenceFileInputFilter()

方法概要

方法

限定符和类型	方法和说明
RecordReader<K,V>	getRecordReader(InputSplit split, JobConf job, Reporter reporter) Create a record reader for the given split
static void	setFilterClass(Configuration conf, Class filterClass) set the filter class

从类继承的方法 org.apache.hadoop.mapred.SequenceFileInputFormat

listStatus

从类继承的方法 org.apache.hadoop.mapred.FileInputFormat

addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, getSplits, isSplitable, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

SequenceFileInputFilter

public SequenceFileInputFilter()

方法详细资料

getRecordReader

public RecordReader<K,V> getRecordReader(InputSplit split,
                                JobConf job,
                                Reporter reporter)
                                  throws IOException

Create a record reader for the given split

指定者:

getRecordReader 在接口中 InputFormat<K,V>

覆盖:

getRecordReader 在类中 SequenceFileInputFormat<K,V>

参数:

split - file split

job - job configuration

reporter - reporter who sends report to task tracker

返回:

RecordReader

抛出:

IOException

setFilterClass

public static void setFilterClass(Configuration conf,
                  Class filterClass)

set the filter class

参数:

conf - application configuration

filterClass - filter class