org.apache.hive.hcatalog.streaming

Class StrictRegexWriter

java.lang.Object

org.apache.hive.hcatalog.streaming.StrictRegexWriter

All Implemented Interfaces:

RecordWriter

public class StrictRegexWriter
extends Object

Streaming Writer handles text input data with regex. Uses org.apache.hadoop.hive.serde2.RegexSerDe

Constructor Summary

Constructors

Constructor and Description
StrictRegexWriter(HiveEndPoint endPoint)
StrictRegexWriter(HiveEndPoint endPoint, HiveConf conf)
StrictRegexWriter(String regex, HiveEndPoint endPoint, HiveConf conf)

Method Summary

Methods

Modifier and Type	Method and Description
void	clear() Clear bufferred writes.
void	closeBatch() Close the RecordUpdater.
void	flush() Flush records from buffer.
void	newBatch(Long minTxnId, Long maxTxnID) Creates a new record updater for the new batch
void	write(long transactionId, byte[] record) Writes using a hive RecordUpdater

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StrictRegexWriter

public StrictRegexWriter(HiveEndPoint endPoint)
                  throws ConnectionError,
                         SerializationError,
                         StreamingException

Parameters:

endPoint - the end point to write to

Throws:

ConnectionError

SerializationError

StreamingException

StrictRegexWriter

public StrictRegexWriter(HiveEndPoint endPoint,
                 HiveConf conf)
                  throws ConnectionError,
                         SerializationError,
                         StreamingException

Parameters:

endPoint - the end point to write to

conf - a Hive conf object. Should be null if not using advanced Hive settings.

Throws:

ConnectionError

SerializationError

StreamingException

StrictRegexWriter

public StrictRegexWriter(String regex,
                 HiveEndPoint endPoint,
                 HiveConf conf)
                  throws ConnectionError,
                         SerializationError,
                         StreamingException

Parameters:

regex - to parse the data

endPoint - the end point to write to

conf - a Hive conf object. Should be null if not using advanced Hive settings.

Throws:

ConnectionError

SerializationError

StreamingException

Method Detail

write

public void write(long transactionId,
         byte[] record)
           throws StreamingIOFailure,
                  SerializationError

Description copied from interface: RecordWriter

Writes using a hive RecordUpdater

Parameters:

transactionId - the ID of the Txn in which the write occurs

record - the record to be written

Throws:

StreamingIOFailure

SerializationError

flush

public void flush()
           throws StreamingIOFailure

Description copied from interface: RecordWriter

Flush records from buffer. Invoked by TransactionBatch.commit()

Specified by:

flush in interface RecordWriter

Throws:

StreamingIOFailure

clear

public void clear()
           throws StreamingIOFailure

Description copied from interface: RecordWriter

Clear bufferred writes. Invoked by TransactionBatch.abort()

Specified by:

clear in interface RecordWriter

Throws:

StreamingIOFailure

newBatch

public void newBatch(Long minTxnId,
            Long maxTxnID)
              throws StreamingIOFailure,
                     SerializationError

Creates a new record updater for the new batch

Specified by:

newBatch in interface RecordWriter

Parameters:

minTxnId - smallest Txnid in the batch

maxTxnID - largest Txnid in the batch

Throws:

StreamingIOFailure - if failed to create record updater

SerializationError

closeBatch

public void closeBatch()
                throws StreamingIOFailure

Description copied from interface: RecordWriter

Close the RecordUpdater. Invoked by TransactionBatch.close()

Specified by:

closeBatch in interface RecordWriter

Throws:

StreamingIOFailure