|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use CompressionCodec | |
---|---|
org.apache.hadoop.io | Generic i/o code for use when reading and writing data to the network, to databases, and to files. |
org.apache.hadoop.io.compress | |
org.apache.hadoop.mapred | A software framework for easily writing applications which process vast amounts of data (multi-terabyte data-sets) parallelly on large clusters (thousands of nodes) built of commodity hardware in a reliable, fault-tolerant manner. |
Uses of CompressionCodec in org.apache.hadoop.io |
---|
Methods in org.apache.hadoop.io that return CompressionCodec | |
---|---|
CompressionCodec |
SequenceFile.Writer.getCompressionCodec()
Returns the compression codec of data in this file. |
CompressionCodec |
SequenceFile.Reader.getCompressionCodec()
Returns the compression codec of data in this file. |
Methods in org.apache.hadoop.io with parameters of type CompressionCodec | |
---|---|
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Construct the preferred type of 'raw' SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata)
Construct the preferred type of 'raw' SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Construct the preferred type of SequenceFile Writer. |
Constructors in org.apache.hadoop.io with parameters of type CompressionCodec | |
---|---|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Create the named map for keys of the named class. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Create the named map using the named key comparator. |
Uses of CompressionCodec in org.apache.hadoop.io.compress |
---|
Classes in org.apache.hadoop.io.compress that implement CompressionCodec | |
---|---|
class |
DefaultCodec
|
class |
GzipCodec
This class creates gzip compressors/decompressors. |
class |
LzoCodec
A CompressionCodec for a streaming
lzo compression/decompression pair. |
Methods in org.apache.hadoop.io.compress that return CompressionCodec | |
---|---|
CompressionCodec |
CompressionCodecFactory.getCodec(Path file)
Find the relevant compression codec for the given file based on its filename suffix. |
Uses of CompressionCodec in org.apache.hadoop.mapred |
---|
Methods in org.apache.hadoop.mapred that return types with arguments of type CompressionCodec | |
---|---|
Class<? extends CompressionCodec> |
JobConf.getMapOutputCompressorClass(Class<? extends CompressionCodec> defaultValue)
Get the CompressionCodec for compressing the map outputs. |
static Class<? extends CompressionCodec> |
OutputFormatBase.getOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> defaultValue)
Get the CompressionCodec for compressing the job outputs. |
Method parameters in org.apache.hadoop.mapred with type arguments of type CompressionCodec | |
---|---|
Class<? extends CompressionCodec> |
JobConf.getMapOutputCompressorClass(Class<? extends CompressionCodec> defaultValue)
Get the CompressionCodec for compressing the map outputs. |
static Class<? extends CompressionCodec> |
OutputFormatBase.getOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> defaultValue)
Get the CompressionCodec for compressing the job outputs. |
void |
JobConf.setMapOutputCompressorClass(Class<? extends CompressionCodec> codecClass)
Set the given class as the CompressionCodec for the map outputs. |
static void |
OutputFormatBase.setOutputCompressorClass(JobConf conf,
Class<? extends CompressionCodec> codecClass)
Set the CompressionCodec to be used to compress job outputs. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |