org.apache.hadoop.mapreduce.lib.partition

类 InputSampler.SplitSampler<K,V>

java.lang.Object

org.apache.hadoop.mapreduce.lib.partition.InputSampler.SplitSampler<K,V>

所有已实现的接口:

InputSampler.Sampler<K,V>

封闭类:

InputSampler<K,V>

public static class InputSampler.SplitSampler<K,V>
extends Object
implements InputSampler.Sampler<K,V>

Samples the first n records from s splits. Inexpensive way to sample random data.

构造器概要

构造器

构造器和说明
InputSampler.SplitSampler(int numSamples) Create a SplitSampler sampling all splits.
InputSampler.SplitSampler(int numSamples, int maxSplitsSampled) Create a new SplitSampler.

方法概要

方法

限定符和类型	方法和说明
K[]	getSample(InputFormat<K,V> inf, Job job) From each split sampled, take the first numSamples / numSplits records.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

InputSampler.SplitSampler

public InputSampler.SplitSampler(int numSamples)

Create a SplitSampler sampling all splits. Takes the first numSamples / numSplits records from each split.

参数:

numSamples - Total number of samples to obtain from all selected splits.

InputSampler.SplitSampler

public InputSampler.SplitSampler(int numSamples,
                         int maxSplitsSampled)

Create a new SplitSampler.

参数:

numSamples - Total number of samples to obtain from all selected splits.

maxSplitsSampled - The maximum number of splits to examine.

方法详细资料

getSample

public K[] getSample(InputFormat<K,V> inf,
            Job job)
              throws IOException,
                     InterruptedException

From each split sampled, take the first numSamples / numSplits records.

指定者:

getSample 在接口中 InputSampler.Sampler<K,V>

抛出:

IOException

InterruptedException