org.apache.hadoop.io.file.tfile

类 TFile.Reader

java.lang.Object

org.apache.hadoop.io.file.tfile.TFile.Reader

所有已实现的接口:

Closeable, AutoCloseable

封闭类:

TFile

public static class TFile.Reader
extends Object
implements Closeable

TFile Reader. Users may only read TFiles by creating TFile.Reader.Scanner. objects. A scanner may scan the whole TFile (createScanner() ) , a portion of TFile based on byte offsets ( createScannerByByteRange(long, long)), or a portion of TFile with keys fall in a certain key range (for sorted TFile only, createScannerByKey(byte[], byte[]) or createScannerByKey(RawComparable, RawComparable)).

嵌套类概要

嵌套类

限定符和类型	类和说明
static class	TFile.Reader.Scanner The TFile Scanner.

构造器概要

构造器

构造器和说明
TFile.Reader(FSDataInputStream fsdis, long fileLength, Configuration conf) Constructor

方法概要

方法

限定符和类型	方法和说明
void	close() Close the reader.
TFile.Reader.Scanner	createScanner() Get a scanner than can scan the whole TFile.
TFile.Reader.Scanner	createScanner(byte[] beginKey, byte[] endKey) 已过时。 Use createScannerByKey(byte[], byte[]) instead.
TFile.Reader.Scanner	createScanner(RawComparable beginKey, RawComparable endKey) 已过时。 Use createScannerByKey(RawComparable, RawComparable) instead.
TFile.Reader.Scanner	createScannerByByteRange(long offset, long length) Get a scanner that covers a portion of TFile based on byte offsets.
TFile.Reader.Scanner	createScannerByKey(byte[] beginKey, byte[] endKey) Get a scanner that covers a portion of TFile based on keys.
TFile.Reader.Scanner	createScannerByKey(RawComparable beginKey, RawComparable endKey) Get a scanner that covers a specific key range.
TFile.Reader.Scanner	createScannerByRecordNum(long beginRecNum, long endRecNum) Create a scanner that covers a range of records.
Comparator<RawComparable>	getComparator() Get an instance of the RawComparator that is constructed based on the string comparator representation.
String	getComparatorName() Get the string representation of the comparator.
Comparator<TFile.Reader.Scanner.Entry>	getEntryComparator() Get a Comparator object to compare Entries.
long	getEntryCount() Get the number of key-value pair entries in TFile.
RawComparable	getFirstKey() Get the first key in the TFile.
RawComparable	getKeyNear(long offset) Get a sample key that is within a block whose starting offset is greater than or equal to the specified offset.
RawComparable	getLastKey() Get the last key in the TFile.
DataInputStream	getMetaBlock(String name) Stream access to a meta block
long	getRecordNumNear(long offset) Get the RecordNum for the first key-value pair in a compressed block whose byte offset in the TFile is greater than or equal to the specified offset.
boolean	isSorted() Is the TFile sorted?

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

TFile.Reader

public TFile.Reader(FSDataInputStream fsdis,
            long fileLength,
            Configuration conf)
             throws IOException

Constructor

参数:

fsdis - FS input stream of the TFile.

fileLength - The length of TFile. This is required because we have no easy way of knowing the actual size of the input file through the File input stream.

conf -

抛出:

IOException

方法详细资料

close

public void close()
           throws IOException

Close the reader. The state of the Reader object is undefined after close. Calling close() for multiple times has no effect.

指定者:

close 在接口中 Closeable

指定者:

close 在接口中 AutoCloseable

抛出:

IOException

getComparatorName

public String getComparatorName()

Get the string representation of the comparator.

返回:

If the TFile is not sorted by keys, an empty string will be returned. Otherwise, the actual comparator string that is provided during the TFile creation time will be returned.

isSorted

public boolean isSorted()

Is the TFile sorted?

返回:

true if TFile is sorted.

getEntryCount

public long getEntryCount()

Get the number of key-value pair entries in TFile.

返回:

the number of key-value pairs in TFile

getFirstKey

public RawComparable getFirstKey()
                          throws IOException

Get the first key in the TFile.

返回:

The first key in the TFile.

抛出:

IOException

getLastKey

public RawComparable getLastKey()
                         throws IOException

Get the last key in the TFile.

返回:

The last key in the TFile.

抛出:

IOException

getEntryComparator

public Comparator<TFile.Reader.Scanner.Entry> getEntryComparator()

Get a Comparator object to compare Entries. It is useful when you want stores the entries in a collection (such as PriorityQueue) and perform sorting or comparison among entries based on the keys without copying out the key.

返回:

An Entry Comparator..

getComparator

public Comparator<RawComparable> getComparator()

Get an instance of the RawComparator that is constructed based on the string comparator representation.

返回:

a Comparator that can compare RawComparable's.

getMetaBlock

public DataInputStream getMetaBlock(String name)
                             throws IOException,
                                    MetaBlockDoesNotExist

Stream access to a meta block.``

参数:

name - The name of the meta block.

返回:

The input stream.

抛出:

IOException - on I/O error.

MetaBlockDoesNotExist - If the meta block with the name does not exist.

getRecordNumNear

public long getRecordNumNear(long offset)
                      throws IOException

Get the RecordNum for the first key-value pair in a compressed block whose byte offset in the TFile is greater than or equal to the specified offset.

参数:

offset - the user supplied offset.

返回:

the RecordNum to the corresponding entry. If no such entry exists, it returns the total entry count.

抛出:

IOException

getKeyNear

public RawComparable getKeyNear(long offset)
                         throws IOException

Get a sample key that is within a block whose starting offset is greater than or equal to the specified offset.

参数:

offset - The file offset.

返回:

the key that fits the requirement; or null if no such key exists (which could happen if the offset is close to the end of the TFile).

抛出:

IOException

createScanner

public TFile.Reader.Scanner createScanner()
                                   throws IOException

Get a scanner than can scan the whole TFile.

返回:

The scanner object. A valid Scanner is always returned even if the TFile is empty.

抛出:

IOException

createScannerByByteRange

public TFile.Reader.Scanner createScannerByByteRange(long offset,
                                            long length)
                                              throws IOException

Get a scanner that covers a portion of TFile based on byte offsets.

参数:

offset - The beginning byte offset in the TFile.

length - The length of the region.

返回:

The actual coverage of the returned scanner tries to match the specified byte-region but always round up to the compression block boundaries. It is possible that the returned scanner contains zero key-value pairs even if length is positive.

抛出:

IOException

createScanner

@Deprecated
public TFile.Reader.Scanner createScanner(byte[] beginKey,
                                            byte[] endKey)
                                   throws IOException

已过时。 Use createScannerByKey(byte[], byte[]) instead.

Get a scanner that covers a portion of TFile based on keys.

参数:

beginKey - Begin key of the scan (inclusive). If null, scan from the first key-value entry of the TFile.

endKey - End key of the scan (exclusive). If null, scan up to the last key-value entry of the TFile.

返回:

The actual coverage of the returned scanner will cover all keys greater than or equal to the beginKey and less than the endKey.

抛出:

IOException

createScannerByKey

public TFile.Reader.Scanner createScannerByKey(byte[] beginKey,
                                      byte[] endKey)
                                        throws IOException

Get a scanner that covers a portion of TFile based on keys.

参数:

beginKey - Begin key of the scan (inclusive). If null, scan from the first key-value entry of the TFile.

endKey - End key of the scan (exclusive). If null, scan up to the last key-value entry of the TFile.

返回:

The actual coverage of the returned scanner will cover all keys greater than or equal to the beginKey and less than the endKey.

抛出:

IOException

createScanner

@Deprecated
public TFile.Reader.Scanner createScanner(RawComparable beginKey,
                                            RawComparable endKey)
                                   throws IOException

已过时。 Use createScannerByKey(RawComparable, RawComparable) instead.

Get a scanner that covers a specific key range.

参数:

beginKey - Begin key of the scan (inclusive). If null, scan from the first key-value entry of the TFile.

endKey - End key of the scan (exclusive). If null, scan up to the last key-value entry of the TFile.

返回:

The actual coverage of the returned scanner will cover all keys greater than or equal to the beginKey and less than the endKey.

抛出:

IOException

createScannerByKey

public TFile.Reader.Scanner createScannerByKey(RawComparable beginKey,
                                      RawComparable endKey)
                                        throws IOException

Get a scanner that covers a specific key range.

参数:

beginKey - Begin key of the scan (inclusive). If null, scan from the first key-value entry of the TFile.

endKey - End key of the scan (exclusive). If null, scan up to the last key-value entry of the TFile.

返回:

The actual coverage of the returned scanner will cover all keys greater than or equal to the beginKey and less than the endKey.

抛出:

IOException

createScannerByRecordNum

public TFile.Reader.Scanner createScannerByRecordNum(long beginRecNum,
                                            long endRecNum)
                                              throws IOException

Create a scanner that covers a range of records.

参数:

beginRecNum - The RecordNum for the first record (inclusive).

endRecNum - The RecordNum for the last record (exclusive). To scan the whole file, either specify endRecNum==-1 or endRecNum==getEntryCount().

返回:

The TFile scanner that covers the specified range of records.

抛出:

IOException