org.apache.hadoop.mapred

类 ShuffleExceptionTracker

java.lang.Object

org.apache.hadoop.mapred.ShuffleExceptionTracker

public class ShuffleExceptionTracker
extends Object

This class is used to track shuffle exceptions. It contains routines to check an exception that occurred while fetching the Map output to see if it matches what was configured. It also provides functions to keep track of the number of exceptions that occurred and if a limit is set, it will abort the TT. The limit is a percent of exceptions of the last X number of requests.

字段概要

字段

限定符和类型	字段和说明
static org.apache.commons.logging.Log	LOG

方法概要

方法

限定符和类型	方法和说明
boolean	checkException(IOException ie) Parse the exception to see if it matches the regular expression you configured.
protected void	doAbort()
void	exception() Mark the request as an exception occurred.
int	getNumRequests() Gets the number of requests we are tracking
float	getPercentExceptions() Gets the percent of the requests that had exceptions occur.
void	success() Mark the request as success.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

LOG

public static final org.apache.commons.logging.Log LOG

方法详细资料

getNumRequests

public int getNumRequests()

Gets the number of requests we are tracking

返回:

number of requests

getPercentExceptions

public float getPercentExceptions()

Gets the percent of the requests that had exceptions occur.

返回:

percent failures as float

success

public void success()

Mark the request as success.

exception

public void exception()

Mark the request as an exception occurred.

checkException

public boolean checkException(IOException ie)

Parse the exception to see if it matches the regular expression you configured. If both msgRegex and StackRegex are set then make sure both match, otherwise only one has to match. Abort if the limit is hit.

参数:

ie - - the shuffle exception that occurred

返回:

true if the exception matches, false otherwise

doAbort

protected void doAbort()