org.apache.hadoop.mapred.lib

类 InputSampler.IntervalSampler<K,V>

java.lang.Object

org.apache.hadoop.mapred.lib.InputSampler.IntervalSampler<K,V>

所有已实现的接口:

InputSampler.Sampler<K,V>

封闭类:

InputSampler<K,V>

public static class InputSampler.IntervalSampler<K,V>
extends Object
implements InputSampler.Sampler<K,V>

Sample from s splits at regular intervals. Useful for sorted data.

构造器概要

构造器

构造器和说明
InputSampler.IntervalSampler(double freq) Create a new IntervalSampler sampling all splits.
InputSampler.IntervalSampler(double freq, int maxSplitsSampled) Create a new IntervalSampler.

方法概要

方法

限定符和类型	方法和说明
K[]	getSample(InputFormat<K,V> inf, JobConf job) For each split sampled, emit when the ratio of the number of records retained to the total record count is less than the specified frequency.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

InputSampler.IntervalSampler

public InputSampler.IntervalSampler(double freq)

Create a new IntervalSampler sampling all splits.

参数:

freq - The frequency with which records will be emitted.

InputSampler.IntervalSampler

public InputSampler.IntervalSampler(double freq,
                            int maxSplitsSampled)

Create a new IntervalSampler.

参数:

freq - The frequency with which records will be emitted.

maxSplitsSampled - The maximum number of splits to examine.

另请参阅:

getSample(org.apache.hadoop.mapred.InputFormat<K, V>, org.apache.hadoop.mapred.JobConf)

方法详细资料

getSample

public K[] getSample(InputFormat<K,V> inf,
            JobConf job)
              throws IOException

For each split sampled, emit when the ratio of the number of records retained to the total record count is less than the specified frequency.

指定者:

getSample 在接口中 InputSampler.Sampler<K,V>

抛出:

IOException