org.apache.hadoop.hive.metastore.txn

Class ValidCompactorTxnList

java.lang.Object

org.apache.hadoop.hive.common.ValidReadTxnList

org.apache.hadoop.hive.metastore.txn.ValidCompactorTxnList

All Implemented Interfaces:

ValidTxnList

public class ValidCompactorTxnList
extends ValidReadTxnList

And implmentation of ValidTxnList for use by the compactor. For the purposes of isTxnRangeValid(long, long) this class will view a transaction as valid if it is committed or aborted. Additionally it will return none if there are any open transactions below the max transaction given, since we don't want to compact above open transactions. For ValidReadTxnList.isTxnValid(long) it will still view a transaction as valid only if it is committed. These produce the logic we need to assure that the compactor only sees records less than the lowest open transaction when choosing which files to compact, but that it still ignores aborted records when compacting.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.hive.common.ValidTxnList

ValidTxnList.RangeResponse

Field Summary

Fields inherited from class org.apache.hadoop.hive.common.ValidReadTxnList

exceptions, highWatermark

Fields inherited from interface org.apache.hadoop.hive.common.ValidTxnList

VALID_TXNS_KEY

Constructor Summary

Constructors

Constructor and Description
ValidCompactorTxnList()
ValidCompactorTxnList(long[] exceptions, long minOpen, long highWatermark)
ValidCompactorTxnList(String value)

Method Summary

Methods

Modifier and Type	Method and Description
ValidTxnList.RangeResponse	isTxnRangeValid(long minTxnId, long maxTxnId) Find out if a range of transaction ids are valid.
void	readFromString(String src) Populate this validTxnList from the string.
String	writeToString() Write this validTxnList into a string.

Methods inherited from class org.apache.hadoop.hive.common.ValidReadTxnList

getHighWatermark, getInvalidTransactions, isTxnValid, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

ValidCompactorTxnList

public ValidCompactorTxnList()

ValidCompactorTxnList

public ValidCompactorTxnList(long[] exceptions,
                     long minOpen,
                     long highWatermark)

Parameters:

exceptions - list of all open and aborted transactions

minOpen - lowest open transaction

highWatermark - highest committed transaction

ValidCompactorTxnList

public ValidCompactorTxnList(String value)

Method Detail

isTxnRangeValid

public ValidTxnList.RangeResponse isTxnRangeValid(long minTxnId,
                                         long maxTxnId)

Description copied from interface: ValidTxnList

Find out if a range of transaction ids are valid. Note that valid may have different meanings for different implementations, as some will only want to see committed transactions and some both committed and aborted.

Specified by:

isTxnRangeValid in interface ValidTxnList

Overrides:

isTxnRangeValid in class ValidReadTxnList

Parameters:

minTxnId - minimum txnid to look for, inclusive

maxTxnId - maximum txnid to look for, inclusive

Returns:

Indicate whether none, some, or all of these transactions are valid.

writeToString

public String writeToString()

Description copied from interface: ValidTxnList

Write this validTxnList into a string. This should produce a string that can be used by ValidTxnList.readFromString(String) to populate a validTxnsList.

Specified by:

writeToString in interface ValidTxnList

Overrides:

writeToString in class ValidReadTxnList

readFromString

public void readFromString(String src)

Description copied from interface: ValidTxnList

Populate this validTxnList from the string. It is assumed that the string was created via ValidTxnList.writeToString().

Specified by:

readFromString in interface ValidTxnList

Overrides:

readFromString in class ValidReadTxnList

Parameters:

src - source string.