org.apache.hadoop.hive.ql.exec.persistence

Class MapJoinBytesTableContainer

java.lang.Object

org.apache.hadoop.hive.ql.exec.persistence.MapJoinBytesTableContainer

All Implemented Interfaces:

MapJoinTableContainer, MapJoinTableContainerDirectAccess

public class MapJoinBytesTableContainer
extends Object
implements MapJoinTableContainer, MapJoinTableContainerDirectAccess

Table container that serializes keys and values using LazyBinarySerDe into BytesBytesMultiHashMap, with very low memory overhead. However, there may be some perf overhead when retrieving rows.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	MapJoinBytesTableContainer.DirectKeyValueWriter
static interface	MapJoinBytesTableContainer.KeyValueHelper

Nested classes/interfaces inherited from interface org.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer

MapJoinTableContainer.ReusableGetAdaptor

Constructor Summary

Constructors

Constructor and Description
MapJoinBytesTableContainer(BytesBytesMultiHashMap hashMap)
MapJoinBytesTableContainer(org.apache.hadoop.conf.Configuration hconf, MapJoinObjectSerDeContext valCtx, long keyCount, long memUsage)

Method Summary

Methods

Modifier and Type	Method and Description
void	clear() Clears the contents of the table.
MapJoinTableContainer.ReusableGetAdaptor	createGetter(MapJoinKey keyTypeFromLoader) Creates reusable get adaptor that can be used to retrieve rows from the table based on either vectorized or non-vectorized input rows to MapJoinOperator.
void	dumpMetrics()
MapJoinKey	getAnyKey()
boolean	hasSpill() Checks if the container has spilled any data onto disk.
static boolean	isSupportedKey(ObjectInspector keyOi)
void	put(org.apache.hadoop.io.Writable currentKey, org.apache.hadoop.io.Writable currentValue)
MapJoinKey	putRow(MapJoinObjectSerDeContext keyContext, org.apache.hadoop.io.Writable currentKey, MapJoinObjectSerDeContext valueContext, org.apache.hadoop.io.Writable currentValue) Adds row from input to the table.
void	seal() Indicates to the container that the puts have ended; table is now r/o.
void	setInternalValueOi(LazyBinaryStructObjectInspector internalValueOi)
void	setSortableSortOrders(boolean[] sortableSortOrders)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MapJoinBytesTableContainer

public MapJoinBytesTableContainer(org.apache.hadoop.conf.Configuration hconf,
                          MapJoinObjectSerDeContext valCtx,
                          long keyCount,
                          long memUsage)
                           throws SerDeException

Throws:

SerDeException

MapJoinBytesTableContainer

public MapJoinBytesTableContainer(BytesBytesMultiHashMap hashMap)

Method Detail

setInternalValueOi

public void setInternalValueOi(LazyBinaryStructObjectInspector internalValueOi)

setSortableSortOrders

public void setSortableSortOrders(boolean[] sortableSortOrders)

putRow

public MapJoinKey putRow(MapJoinObjectSerDeContext keyContext,
                org.apache.hadoop.io.Writable currentKey,
                MapJoinObjectSerDeContext valueContext,
                org.apache.hadoop.io.Writable currentValue)
                  throws SerDeException

Description copied from interface: MapJoinTableContainer

Adds row from input to the table.

Specified by:

putRow in interface MapJoinTableContainer

Throws:

SerDeException

clear

public void clear()

Description copied from interface: MapJoinTableContainer

Clears the contents of the table.

Specified by:

clear in interface MapJoinTableContainer

getAnyKey

public MapJoinKey getAnyKey()

Specified by:

getAnyKey in interface MapJoinTableContainer

createGetter

public MapJoinTableContainer.ReusableGetAdaptor createGetter(MapJoinKey keyTypeFromLoader)

Description copied from interface: MapJoinTableContainer

Creates reusable get adaptor that can be used to retrieve rows from the table based on either vectorized or non-vectorized input rows to MapJoinOperator.

Specified by:

createGetter in interface MapJoinTableContainer

Parameters:

keyTypeFromLoader - Last key from hash table loader, to determine key type used when loading hashtable (if it can vary).

seal

public void seal()

Description copied from interface: MapJoinTableContainer

Indicates to the container that the puts have ended; table is now r/o.

Specified by:

seal in interface MapJoinTableContainer

put

public void put(org.apache.hadoop.io.Writable currentKey,
       org.apache.hadoop.io.Writable currentValue)
         throws SerDeException

Specified by:

put in interface MapJoinTableContainerDirectAccess

Throws:

SerDeException

isSupportedKey

public static boolean isSupportedKey(ObjectInspector keyOi)

dumpMetrics

public void dumpMetrics()

Specified by:

dumpMetrics in interface MapJoinTableContainer

hasSpill

public boolean hasSpill()

Description copied from interface: MapJoinTableContainer

Checks if the container has spilled any data onto disk. This is only applicable for HybridHashTableContainer.

Specified by:

hasSpill in interface MapJoinTableContainer