org.apache.hadoop.hive.ql.exec.errors

Class MapAggrMemErrorHeuristic

java.lang.Object

org.apache.hadoop.hive.ql.exec.errors.RegexErrorHeuristic

org.apache.hadoop.hive.ql.exec.errors.MapAggrMemErrorHeuristic

All Implemented Interfaces:

ErrorHeuristic

public class MapAggrMemErrorHeuristic
extends RegexErrorHeuristic

Detects out-of-memory errors when hash tables in map-based aggregation group by queries take up too much memory. Conditions to check 1. The query contains a group by. 2. Map-side aggregation is turned on. 3. There is a out of memory exception in the log.

Constructor Summary

Constructors

Constructor and Description
MapAggrMemErrorHeuristic()

Method Summary

Methods

Modifier and Type	Method and Description
ErrorAndSolution	getErrorAndSolution() Examine the hive query, job configuration, and the lines from the task log seen so far though processLogLine() and generate a possible cause/solution.
void	init(String query, org.apache.hadoop.mapred.JobConf conf) Initialize this error heuristic.

Methods inherited from class org.apache.hadoop.hive.ql.exec.errors.RegexErrorHeuristic

getConf, getLogRegexes, getQueryMatches, getQueryRegex, getRegexToLogLines, processLogLine, reset, setQueryRegex

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MapAggrMemErrorHeuristic

public MapAggrMemErrorHeuristic()

Method Detail

init

public void init(String query,
        org.apache.hadoop.mapred.JobConf conf)

Description copied from interface: ErrorHeuristic

Initialize this error heuristic. Must be called before any other methods are called

Specified by:

init in interface ErrorHeuristic

Overrides:

init in class RegexErrorHeuristic

getErrorAndSolution

public ErrorAndSolution getErrorAndSolution()

Description copied from interface: ErrorHeuristic

Examine the hive query, job configuration, and the lines from the task log seen so far though processLogLine() and generate a possible cause/solution. Once this method is called, the implementing class should be reset to the state before any processLogLine() calls were made.

Specified by:

getErrorAndSolution in interface ErrorHeuristic

Specified by:

getErrorAndSolution in class RegexErrorHeuristic

Returns:

a matching error, or null if a suitable match wasn't found.