程序包 | 说明 |
---|---|
org.apache.hadoop.contrib.index.example | |
org.apache.hadoop.contrib.index.lucene | |
org.apache.hadoop.contrib.index.mapred |
限定符和类型 | 方法和说明 |
---|---|
void |
RoundRobinDistributionPolicy.init(Shard[] shards) |
void |
HashingDistributionPolicy.init(Shard[] shards) |
构造器和说明 |
---|
ShardWriter(FileSystem fs,
Shard shard,
String tempDir,
IndexUpdateConfiguration iconf)
Constructor
|
限定符和类型 | 方法和说明 |
---|---|
static Shard[] |
Shard.getIndexShards(IndexUpdateConfiguration conf) |
限定符和类型 | 方法和说明 |
---|---|
RecordWriter<Shard,Text> |
IndexUpdateOutputFormat.getRecordWriter(FileSystem fs,
JobConf job,
String name,
Progressable progress) |
限定符和类型 | 方法和说明 |
---|---|
int |
Shard.compareTo(Shard other)
Compare to another shard.
|
int |
IndexUpdatePartitioner.getPartition(Shard key,
IntermediateForm value,
int numPartitions) |
void |
IDistributionPolicy.init(Shard[] shards)
Initialization.
|
void |
IndexUpdateCombiner.reduce(Shard key,
Iterator<IntermediateForm> values,
OutputCollector<Shard,IntermediateForm> output,
Reporter reporter) |
void |
IndexUpdateReducer.reduce(Shard key,
Iterator<IntermediateForm> values,
OutputCollector<Shard,Text> output,
Reporter reporter) |
void |
IndexUpdater.run(Configuration conf,
Path[] inputPaths,
Path outputPath,
int numMapTasks,
Shard[] shards) |
void |
IIndexUpdater.run(Configuration conf,
Path[] inputPaths,
Path outputPath,
int numMapTasks,
Shard[] shards)
Create a Map/Reduce job configuration and run the Map/Reduce job to
analyze documents and update Lucene instances in parallel.
|
static void |
Shard.setIndexShards(IndexUpdateConfiguration conf,
Shard[] shards) |
限定符和类型 | 方法和说明 |
---|---|
void |
IndexUpdateMapper.map(K key,
V value,
OutputCollector<Shard,IntermediateForm> output,
Reporter reporter)
Map a key-value pair to a shard-and-intermediate form pair.
|
void |
IndexUpdateCombiner.reduce(Shard key,
Iterator<IntermediateForm> values,
OutputCollector<Shard,IntermediateForm> output,
Reporter reporter) |
void |
IndexUpdateReducer.reduce(Shard key,
Iterator<IntermediateForm> values,
OutputCollector<Shard,Text> output,
Reporter reporter) |
构造器和说明 |
---|
Shard(Shard shard)
Construct using a shard object.
|
Copyright © 2009 The Apache Software Foundation