org.apache.hadoop.util

类 QueueProcessingStatistics

java.lang.Object

org.apache.hadoop.util.QueueProcessingStatistics

public abstract class QueueProcessingStatistics
extends Object

Hadoop has several work queues, such as FSNamesystem.neededReplications With a properly throttled queue, a worker thread cycles repeatedly, doing a chunk of work each cycle then resting a bit, until the queue is empty. This class is intended to collect statistics about the behavior of such queues and consumers. It reports the amount of work done and how long it took, for the first cycle after collection starts, and for the total number of cycles needed to flush the queue. We use a state machine to detect when the queue has been flushed and then we log the stats; see QueueProcessingStatistics.State for enumeration of the states and their meanings.

嵌套类概要

嵌套类

限定符和类型	类和说明
static class	QueueProcessingStatistics.State This enum provides the "states" of a state machine for QueueProcessingStatistics.

构造器概要

构造器

构造器和说明
QueueProcessingStatistics(String queueName, String workItemsName, org.apache.commons.logging.Log logObject)

方法概要

方法

限定符和类型	方法和说明
void	checkRestart()
void	endCycle(int workFound)
abstract boolean	postCheckIsLastCycle(int workFound) See preCheckIsLastCycle(int).
abstract boolean	preCheckIsLastCycle(int maxWorkToProcess) The termination condition is to identify the last cycle that will empty the queue.
void	startCycle(int maxWorkToProcess)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

QueueProcessingStatistics

public QueueProcessingStatistics(String queueName,
                         String workItemsName,
                         org.apache.commons.logging.Log logObject)

参数:

queueName - - Human-readable name of the queue being monitored, used as first word in the log messages.

workItemsName - - what kind of work items are being managed on the queue? A plural word is best here, for logging.

logObject - - What log do you want the log messages to be sent to?

方法详细资料

startCycle

public void startCycle(int maxWorkToProcess)

endCycle

public void endCycle(int workFound)

checkRestart

public void checkRestart()

preCheckIsLastCycle

public abstract boolean preCheckIsLastCycle(int maxWorkToProcess)

The termination condition is to identify the last cycle that will empty the queue. Two abstract APIs are called: preCheckIsLastCycle is called at the beginning of each cycle, and postCheckIsLastCycle(int) is called at the end of each cycle. At least one of them must correctly provide the termination condition. The other may always return 'false'. If either of them returns 'true' in a given cycle, then at the end of that cycle the stats will be output to log, and stats collection will end.

参数:

maxWorkToProcess - - if this number is greater than the amount of work remaining at the start of a cycle, then it will be the last cycle.

返回:

- true if last cycle detected, else false

postCheckIsLastCycle

public abstract boolean postCheckIsLastCycle(int workFound)

See preCheckIsLastCycle(int).

参数:

workFound - - may not be useful

返回:

- true if remaining work is zero at end of cycle, else false