org.apache.hadoop.hive.ql.exec

Class SMBMapJoinOperator

java.lang.Object

org.apache.hadoop.hive.ql.exec.Operator<T>

org.apache.hadoop.hive.ql.exec.CommonJoinOperator<T>

org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator<SMBJoinDesc>

org.apache.hadoop.hive.ql.exec.SMBMapJoinOperator

All Implemented Interfaces:

Serializable, Cloneable, Node

Direct Known Subclasses:

VectorSMBMapJoinOperator

public class SMBMapJoinOperator
extends AbstractMapJoinOperator<SMBJoinDesc>
implements Serializable

Sorted Merge Map Join Operator.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator

Operator.OperatorFunc, Operator.State

Field Summary

Fields inherited from class org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator

emptyList, joinKeys, joinKeysObjectInspectors, posBigTable

Fields inherited from class org.apache.hadoop.hive.ql.exec.CommonJoinOperator

alias, aliasFilterTags, condn, countAfterReport, dummyObj, dummyObjVectors, filterMaps, filterTags, forwardCache, hconf, heartbeatInterval, intermediate, joinFilterObjectInspectors, joinFilters, joinValues, joinValuesObjectInspectors, joinValuesStandardObjectInspectors, noOuterJoin, NOTSKIPBIGTABLE, nullsafes, numAliases, offsets, order, rowContainerStandardObjectInspectors, skipVectors, spillTableDesc, totalSz

Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator

childOperators, childOperatorsArray, childOperatorsTag, colExprMap, conf, CONTEXT_NAME_KEY, done, groupKeyObject, HIVECOUNTERCREATEDFILES, HIVECOUNTERFATAL, id, inputObjInspectors, isLogDebugEnabled, isLogInfoEnabled, isLogTraceEnabled, operatorId, out, outputObjInspector, parentOperators, PLOG, reporter, state, statsMap

Constructor Summary

Constructors

Constructor and Description
SMBMapJoinOperator()
SMBMapJoinOperator(AbstractMapJoinOperator<? extends MapJoinDesc> mapJoinOp)

Method Summary

Methods

Modifier and Type	Method and Description
protected boolean	allInitializedParentsAreClosed()
void	cleanUpInputFileChangedOp()
void	closeOp(boolean abort) All done.
String	getName() Implements the getName function for the Node Interface.
static String	getOperatorName()
OperatorType	getType() Return the type of the specific operator among the types in OperatorType.
void	initializeLocalWork(org.apache.hadoop.conf.Configuration hconf)
void	initializeMapredLocalWork(MapJoinDesc mjConf, org.apache.hadoop.conf.Configuration hconf, MapredLocalWork localWork, org.apache.commons.logging.Log l4j)
protected Collection<Future<?>>	initializeOp(org.apache.hadoop.conf.Configuration hconf) Operator specific initialization.
boolean	isConvertedAutomaticallySMBJoin()
boolean	opAllowedConvertMapJoin()
void	process(Object row, int tag) Process the row.
void	setConvertedAutomaticallySMBJoin(boolean convertedAutomaticallySMBJoin)
protected List<Object>	smbJoinComputeKeys(Object row, byte alias)

Methods inherited from class org.apache.hadoop.hive.ql.exec.AbstractMapJoinOperator

getValueObjectInspectors

Methods inherited from class org.apache.hadoop.hive.ql.exec.CommonJoinOperator

checkAndGenObject, endGroup, getFilteredValue, getFilterTag, getNextSize, getPosToAliasMap, hasFilter, internalForward, opAllowedAfterMapJoin, opAllowedBeforeMapJoin, reportProgress, setPosToAliasMap, startGroup

Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator

acceptLimitPushdown, areAllParentsInitialized, augmentPlan, cleanUpInputFileChanged, clone, cloneOp, cloneRecursiveChildren, close, columnNamesRowResolvedCanBeObtained, completeInitializationOp, createDummy, defaultEndGroup, defaultStartGroup, dump, dump, flush, forward, getAdditionalCounters, getChildOperators, getChildren, getColumnExprMap, getConf, getConfiguration, getDone, getExecContext, getGroupKeyObject, getIdentifier, getInputObjInspectors, getNextCntr, getNumChild, getNumParent, getOperatorId, getOpTraits, getOutputObjInspector, getParentOperators, getSchema, getStatistics, getStats, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initialize, initializeChildren, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logStats, opAllowedBeforeSortMergeJoin, passExecContext, preorderMap, processGroup, removeChild, removeChildAndAdoptItsChildren, removeChildren, removeParent, replaceChild, replaceParent, reset, resetId, resetStats, setAlias, setChildOperators, setColumnExprMap, setConf, setDone, setExecContext, setGroupKeyObject, setId, setInputContext, setInputObjInspectors, setOperatorId, setOpTraits, setOutputCollector, setParentOperators, setReporter, setSchema, setStatistics, setUseBucketizedHiveInputFormat, supportAutomaticSortMergeJoin, supportSkewJoinOptimization, supportUnionRemoveOptimization, toString, toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

SMBMapJoinOperator

public SMBMapJoinOperator()

SMBMapJoinOperator

public SMBMapJoinOperator(AbstractMapJoinOperator<? extends MapJoinDesc> mapJoinOp)

Method Detail

initializeOp

protected Collection<Future<?>> initializeOp(org.apache.hadoop.conf.Configuration hconf)
                                      throws HiveException

Description copied from class: Operator

Operator specific initialization.

Overrides:

initializeOp in class AbstractMapJoinOperator<SMBJoinDesc>

Throws:

HiveException

initializeLocalWork

public void initializeLocalWork(org.apache.hadoop.conf.Configuration hconf)
                         throws HiveException

Overrides:

initializeLocalWork in class Operator<SMBJoinDesc>

Throws:

HiveException

initializeMapredLocalWork

public void initializeMapredLocalWork(MapJoinDesc mjConf,
                             org.apache.hadoop.conf.Configuration hconf,
                             MapredLocalWork localWork,
                             org.apache.commons.logging.Log l4j)
                               throws HiveException

Throws:

HiveException

cleanUpInputFileChangedOp

public void cleanUpInputFileChangedOp()
                               throws HiveException

Overrides:

cleanUpInputFileChangedOp in class Operator<SMBJoinDesc>

Throws:

HiveException

smbJoinComputeKeys

protected List<Object> smbJoinComputeKeys(Object row,
                              byte alias)
                                   throws HiveException

Throws:

HiveException

process

public void process(Object row,
           int tag)
             throws HiveException

Description copied from class: Operator

Process the row.

Specified by:

process in class Operator<SMBJoinDesc>

Parameters:

row - The object representing the row.

tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.

Throws:

HiveException

closeOp

public void closeOp(boolean abort)
             throws HiveException

Description copied from class: CommonJoinOperator

All done.

Overrides:

closeOp in class AbstractMapJoinOperator<SMBJoinDesc>

Throws:

HiveException

allInitializedParentsAreClosed

protected boolean allInitializedParentsAreClosed()

Overrides:

allInitializedParentsAreClosed in class Operator<SMBJoinDesc>

getName

public String getName()

Implements the getName function for the Node Interface.

Specified by:

getName in interface Node

Overrides:

getName in class CommonJoinOperator<SMBJoinDesc>

Returns:

the name of the operator

getOperatorName

public static String getOperatorName()

getType

public OperatorType getType()

Description copied from class: Operator

Return the type of the specific operator among the types in OperatorType.

Overrides:

getType in class AbstractMapJoinOperator<SMBJoinDesc>

Returns:

OperatorType.*

isConvertedAutomaticallySMBJoin

public boolean isConvertedAutomaticallySMBJoin()

setConvertedAutomaticallySMBJoin

public void setConvertedAutomaticallySMBJoin(boolean convertedAutomaticallySMBJoin)

opAllowedConvertMapJoin

public boolean opAllowedConvertMapJoin()

Overrides:

opAllowedConvertMapJoin in class Operator<SMBJoinDesc>