org.apache.hadoop.streaming

类 StreamKeyValUtil

java.lang.Object

org.apache.hadoop.streaming.StreamKeyValUtil

public class StreamKeyValUtil
extends Object

构造器概要

构造器

构造器和说明
StreamKeyValUtil()

方法概要

方法

限定符和类型	方法和说明
static int	findTab(byte[] utf) Find the first occured tab in a UTF-8 encoded string
static int	findTab(byte[] utf, int start, int length) Find the first occured tab in a UTF-8 encoded string
static int	readLine(LineReader lineReader, Text out) Read a utf8 encoded line from a data input stream.
static void	splitKeyVal(byte[] utf, int start, int length, Text key, Text val, int splitPos) split a UTF-8 byte array into key and value assuming that the delimilator is at splitpos.
static void	splitKeyVal(byte[] utf, int start, int length, Text key, Text val, int splitPos, int separatorLength) split a UTF-8 byte array into key and value assuming that the delimilator is at splitpos.
static void	splitKeyVal(byte[] utf, Text key, Text val, int splitPos) split a UTF-8 byte array into key and value assuming that the delimilator is at splitpos.
static void	splitKeyVal(byte[] utf, Text key, Text val, int splitPos, int separatorLength) split a UTF-8 byte array into key and value assuming that the delimilator is at splitpos.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

StreamKeyValUtil

public StreamKeyValUtil()

方法详细资料

findTab

public static int findTab(byte[] utf,
          int start,
          int length)

Find the first occured tab in a UTF-8 encoded string

参数:

utf - a byte array containing a UTF-8 encoded string

start - starting offset

length - no. of bytes

返回:

position that first tab occures otherwise -1

findTab

public static int findTab(byte[] utf)

Find the first occured tab in a UTF-8 encoded string

参数:

utf - a byte array containing a UTF-8 encoded string

返回:

position that first tab occures otherwise -1

splitKeyVal

public static void splitKeyVal(byte[] utf,
               int start,
               int length,
               Text key,
               Text val,
               int splitPos,
               int separatorLength)
                        throws IOException

split a UTF-8 byte array into key and value assuming that the delimilator is at splitpos.

参数:

utf - utf-8 encoded string

start - starting offset

length - no. of bytes

key - contains key upon the method is returned

val - contains value upon the method is returned

splitPos - the split pos

separatorLength - the length of the separator between key and value

抛出:

IOException

splitKeyVal

public static void splitKeyVal(byte[] utf,
               int start,
               int length,
               Text key,
               Text val,
               int splitPos)
                        throws IOException

split a UTF-8 byte array into key and value assuming that the delimilator is at splitpos.

参数:

utf - utf-8 encoded string

start - starting offset

length - no. of bytes

key - contains key upon the method is returned

val - contains value upon the method is returned

splitPos - the split pos

抛出:

IOException

splitKeyVal

public static void splitKeyVal(byte[] utf,
               Text key,
               Text val,
               int splitPos,
               int separatorLength)
                        throws IOException

split a UTF-8 byte array into key and value assuming that the delimilator is at splitpos.

参数:

utf - utf-8 encoded string

key - contains key upon the method is returned

val - contains value upon the method is returned

splitPos - the split pos

separatorLength - the length of the separator between key and value

抛出:

IOException

splitKeyVal

public static void splitKeyVal(byte[] utf,
               Text key,
               Text val,
               int splitPos)
                        throws IOException

split a UTF-8 byte array into key and value assuming that the delimilator is at splitpos.

参数:

utf - utf-8 encoded string

key - contains key upon the method is returned

val - contains value upon the method is returned

splitPos - the split pos

抛出:

IOException

readLine

public static int readLine(LineReader lineReader,
           Text out)
                    throws IOException

Read a utf8 encoded line from a data input stream.

参数:

lineReader - LineReader to read the line from.

out - Text to read into

返回:

number of bytes read

抛出:

IOException