接口 org.apache.hadoop.io.compress.CompressionCodec
的使用

使用CompressionCodec的程序包

程序包	说明
org.apache.hadoop.io	Generic i/o code for use when reading and writing data to the network, to databases, and to files.
org.apache.hadoop.io.compress
org.apache.hadoop.mapred	A software framework for easily writing applications which process vast amounts of data (multi-terabyte data-sets) parallelly on large clusters (thousands of nodes) built of commodity hardware in a reliable, fault-tolerant manner.
org.apache.hadoop.mapreduce.lib.output

org.apache.hadoop.io中CompressionCodec的使用

返回CompressionCodec的org.apache.hadoop.io中的方法

限定符和类型	方法和说明
CompressionCodec	SequenceFile.Writer.getCompressionCodec() Returns the compression codec of data in this file.
CompressionCodec	SequenceFile.Reader.getCompressionCodec() Returns the compression codec of data in this file.

参数类型为CompressionCodec的org.apache.hadoop.io中的方法

限定符和类型	方法和说明
static SequenceFile.Writer	SequenceFile.createWriter(Configuration conf, FSDataOutputStream out, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec) Construct the preferred type of 'raw' SequenceFile Writer.
static SequenceFile.Writer	SequenceFile.createWriter(Configuration conf, FSDataOutputStream out, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec, SequenceFile.Metadata metadata) Construct the preferred type of 'raw' SequenceFile Writer.
static SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, int bufferSize, short replication, long blockSize, boolean createParent, SequenceFile.CompressionType compressionType, CompressionCodec codec, SequenceFile.Metadata metadata) Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, int bufferSize, short replication, long blockSize, SequenceFile.CompressionType compressionType, CompressionCodec codec, Progressable progress, SequenceFile.Metadata metadata) Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec) Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec, Progressable progress) Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer	SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec, Progressable progress, SequenceFile.Metadata metadata) Construct the preferred type of SequenceFile Writer.

参数类型为CompressionCodec的org.apache.hadoop.io中的构造器

构造器和说明
BloomMapFile.Writer(Configuration conf, FileSystem fs, String dirName, Class<? extends WritableComparable> keyClass, Class<? extends Writable> valClass, SequenceFile.CompressionType compress, CompressionCodec codec, Progressable progress)
BloomMapFile.Writer(Configuration conf, FileSystem fs, String dirName, WritableComparator comparator, Class valClass, SequenceFile.CompressionType compress, CompressionCodec codec, Progressable progress)
MapFile.Writer(Configuration conf, FileSystem fs, String dirName, Class<? extends WritableComparable> keyClass, Class valClass, SequenceFile.CompressionType compress, CompressionCodec codec, Progressable progress) Create the named map for keys of the named class.
MapFile.Writer(Configuration conf, FileSystem fs, String dirName, WritableComparator comparator, Class valClass, SequenceFile.CompressionType compress, CompressionCodec codec, Progressable progress) Create the named map using the named key comparator.

org.apache.hadoop.io.compress中CompressionCodec的使用

org.apache.hadoop.io.compress中CompressionCodec的子接口

限定符和类型	接口和说明
interface	SplittableCompressionCodec This interface is meant to be implemented by those compression codecs which are capable to compress / decompress a stream starting at any arbitrary position.

实现CompressionCodec的org.apache.hadoop.io.compress中的类

限定符和类型	类和说明
class	BZip2Codec This class provides CompressionOutputStream and CompressionInputStream for compression and decompression.
class	DefaultCodec
class	GzipCodec This class creates gzip compressors/decompressors.
class	SnappyCodec This class creates snappy compressors/decompressors.

返回CompressionCodec的org.apache.hadoop.io.compress中的方法

限定符和类型	方法和说明
CompressionCodec	CompressionCodecFactory.getCodec(Path file) Find the relevant compression codec for the given file based on its filename suffix.
CompressionCodec	CompressionCodecFactory.getCodecByClassName(String classname) Find the relevant compression codec for the codec's canonical class name.
CompressionCodec	CompressionCodecFactory.getCodecByName(String codecName) Find the relevant compression codec for the codec's canonical class name or by codec alias.

返回变量类型为CompressionCodec的类型的org.apache.hadoop.io.compress中的方法

限定符和类型	方法和说明
Class<? extends CompressionCodec>	CompressionCodecFactory.getCodecClassByName(String codecName) Find the relevant compression codec for the codec's canonical class name or by codec alias and returns its implemetation class.
static List<Class<? extends CompressionCodec>>	CompressionCodecFactory.getCodecClasses(Configuration conf) Get the list of codecs listed in the configuration

参数类型为CompressionCodec的org.apache.hadoop.io.compress中的方法

限定符和类型	方法和说明
static Compressor	CodecPool.getCompressor(CompressionCodec codec)
static Compressor	CodecPool.getCompressor(CompressionCodec codec, Configuration conf) Get a Compressor for the given CompressionCodec from the pool or a new one.
static Decompressor	CodecPool.getDecompressor(CompressionCodec codec) Get a Decompressor for the given CompressionCodec from the pool or a new one.

org.apache.hadoop.mapred中CompressionCodec的使用

返回变量类型为CompressionCodec的类型的org.apache.hadoop.mapred中的方法

限定符和类型	方法和说明
Class<? extends CompressionCodec>	JobConf.getMapOutputCompressorClass(Class<? extends CompressionCodec> defaultValue) Get the CompressionCodec for compressing the map outputs.
static Class<? extends CompressionCodec>	FileOutputFormat.getOutputCompressorClass(JobConf conf, Class<? extends CompressionCodec> defaultValue) Get the CompressionCodec for compressing the job outputs.

类型变量类型为CompressionCodec的org.apache.hadoop.mapred中的方法参数

限定符和类型	方法和说明
Class<? extends CompressionCodec>	JobConf.getMapOutputCompressorClass(Class<? extends CompressionCodec> defaultValue) Get the CompressionCodec for compressing the map outputs.
static Class<? extends CompressionCodec>	FileOutputFormat.getOutputCompressorClass(JobConf conf, Class<? extends CompressionCodec> defaultValue) Get the CompressionCodec for compressing the job outputs.
void	JobConf.setMapOutputCompressorClass(Class<? extends CompressionCodec> codecClass) Set the given class as the CompressionCodec for the map outputs.
static void	FileOutputFormat.setOutputCompressorClass(JobConf conf, Class<? extends CompressionCodec> codecClass) Set the CompressionCodec to be used to compress job outputs.

org.apache.hadoop.mapreduce.lib.output中CompressionCodec的使用

返回变量类型为CompressionCodec的类型的org.apache.hadoop.mapreduce.lib.output中的方法

限定符和类型	方法和说明
static Class<? extends CompressionCodec>	FileOutputFormat.getOutputCompressorClass(JobContext job, Class<? extends CompressionCodec> defaultValue) Get the CompressionCodec for compressing the job outputs.

类型变量类型为CompressionCodec的org.apache.hadoop.mapreduce.lib.output中的方法参数

限定符和类型	方法和说明
static Class<? extends CompressionCodec>	FileOutputFormat.getOutputCompressorClass(JobContext job, Class<? extends CompressionCodec> defaultValue) Get the CompressionCodec for compressing the job outputs.
static void	FileOutputFormat.setOutputCompressorClass(Job job, Class<? extends CompressionCodec> codecClass) Set the CompressionCodec to be used to compress job outputs.