org.apache.hadoop.mapred

类 SequenceFileAsBinaryOutputFormat

java.lang.Object

org.apache.hadoop.mapred.FileOutputFormat<K,V>

org.apache.hadoop.mapred.SequenceFileOutputFormat<BytesWritable,BytesWritable>

org.apache.hadoop.mapred.SequenceFileAsBinaryOutputFormat

所有已实现的接口:

OutputFormat<BytesWritable,BytesWritable>

public class SequenceFileAsBinaryOutputFormat
extends SequenceFileOutputFormat<BytesWritable,BytesWritable>

An OutputFormat that writes keys, values to SequenceFiles in binary(raw) format

嵌套类概要

嵌套类

限定符和类型	类和说明
protected static class	SequenceFileAsBinaryOutputFormat.WritableValueBytes Inner class used for appendRaw

从类继承的嵌套类/接口 org.apache.hadoop.mapred.FileOutputFormat

FileOutputFormat.Counter

构造器概要

构造器

构造器和说明
SequenceFileAsBinaryOutputFormat()

方法概要

方法

限定符和类型	方法和说明
void	checkOutputSpecs(FileSystem ignored, JobConf job) Check for validity of the output-specification for the job.
RecordWriter<BytesWritable,BytesWritable>	getRecordWriter(FileSystem ignored, JobConf job, String name, Progressable progress) Get the RecordWriter for the given job.
static Class<? extends WritableComparable>	getSequenceFileOutputKeyClass(JobConf conf) Get the key class for the SequenceFile
static Class<? extends Writable>	getSequenceFileOutputValueClass(JobConf conf) Get the value class for the SequenceFile
static void	setSequenceFileOutputKeyClass(JobConf conf, Class<?> theClass) Set the key class for the SequenceFile This allows the user to specify the key class to be different from the actual class (BytesWritable) used for writing
static void	setSequenceFileOutputValueClass(JobConf conf, Class<?> theClass) Set the value class for the SequenceFile This allows the user to specify the value class to be different from the actual class (BytesWritable) used for writing

从类继承的方法 org.apache.hadoop.mapred.SequenceFileOutputFormat

getOutputCompressionType, getReaders, setOutputCompressionType

从类继承的方法 org.apache.hadoop.mapred.FileOutputFormat

getCompressOutput, getOutputCompressorClass, getOutputPath, getPathForCustomFile, getTaskOutputPath, getUniqueName, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

SequenceFileAsBinaryOutputFormat

public SequenceFileAsBinaryOutputFormat()

方法详细资料

setSequenceFileOutputKeyClass

public static void setSequenceFileOutputKeyClass(JobConf conf,
                                 Class<?> theClass)

Set the key class for the SequenceFile

This allows the user to specify the key class to be different from the actual class (BytesWritable) used for writing

参数:

conf - the JobConf to modify

theClass - the SequenceFile output key class.

setSequenceFileOutputValueClass

public static void setSequenceFileOutputValueClass(JobConf conf,
                                   Class<?> theClass)

Set the value class for the SequenceFile

This allows the user to specify the value class to be different from the actual class (BytesWritable) used for writing

参数:

conf - the JobConf to modify

theClass - the SequenceFile output key class.

getSequenceFileOutputKeyClass

public static Class<? extends WritableComparable> getSequenceFileOutputKeyClass(JobConf conf)

Get the key class for the SequenceFile

返回:

the key class of the SequenceFile

getSequenceFileOutputValueClass

public static Class<? extends Writable> getSequenceFileOutputValueClass(JobConf conf)

Get the value class for the SequenceFile

返回:

the value class of the SequenceFile

getRecordWriter

public RecordWriter<BytesWritable,BytesWritable> getRecordWriter(FileSystem ignored,
                                                        JobConf job,
                                                        String name,
                                                        Progressable progress)
                                                          throws IOException

从接口复制的说明: OutputFormat

Get the RecordWriter for the given job.

指定者:

getRecordWriter 在接口中 OutputFormat<BytesWritable,BytesWritable>

覆盖:

getRecordWriter 在类中 SequenceFileOutputFormat<BytesWritable,BytesWritable>

job - configuration for the job whose output is being written.

name - the unique name for this part of the output.

progress - mechanism for reporting progress while writing to file.

返回:

a RecordWriter to write the output for the job.

抛出:

IOException

checkOutputSpecs

public void checkOutputSpecs(FileSystem ignored,
                    JobConf job)
                      throws IOException

从接口复制的说明: OutputFormat

Check for validity of the output-specification for the job.

This is to validate the output specification for the job when it is a job is submitted. Typically checks that it does not already exist, throwing an exception when it already exists, so that output is not overwritten.

指定者:

checkOutputSpecs 在接口中 OutputFormat<BytesWritable,BytesWritable>

覆盖:

checkOutputSpecs 在类中 FileOutputFormat<BytesWritable,BytesWritable>

job - job configuration.

抛出:

IOException - when output should not be attempted