org.apache.hadoop.hive.ql.io
Class HiveSequenceFileOutputFormat
java.lang.Object
org.apache.hadoop.mapred.FileOutputFormat<K,V>
org.apache.hadoop.mapred.SequenceFileOutputFormat
org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
- All Implemented Interfaces:
- HiveOutputFormat<org.apache.hadoop.io.WritableComparable,org.apache.hadoop.io.Writable>, org.apache.hadoop.mapred.OutputFormat
public class HiveSequenceFileOutputFormat
- extends org.apache.hadoop.mapred.SequenceFileOutputFormat
- implements HiveOutputFormat<org.apache.hadoop.io.WritableComparable,org.apache.hadoop.io.Writable>
A HiveOutputFormat
that writes SequenceFile
s.
Method Summary |
FileSinkOperator.RecordWriter |
getHiveRecordWriter(org.apache.hadoop.mapred.JobConf jc,
org.apache.hadoop.fs.Path finalOutPath,
Class<? extends org.apache.hadoop.io.Writable> valueClass,
boolean isCompressed,
Properties tableProperties,
org.apache.hadoop.util.Progressable progress)
create the final out file, and output an empty key as the key. |
Methods inherited from class org.apache.hadoop.mapred.SequenceFileOutputFormat |
getOutputCompressionType, getReaders, getRecordWriter, setOutputCompressionType |
Methods inherited from class org.apache.hadoop.mapred.FileOutputFormat |
checkOutputSpecs, getCompressOutput, getOutputCompressorClass, getOutputPath, getPathForCustomFile, getTaskOutputPath, getUniqueName, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
HiveSequenceFileOutputFormat
public HiveSequenceFileOutputFormat()
getHiveRecordWriter
public FileSinkOperator.RecordWriter getHiveRecordWriter(org.apache.hadoop.mapred.JobConf jc,
org.apache.hadoop.fs.Path finalOutPath,
Class<? extends org.apache.hadoop.io.Writable> valueClass,
boolean isCompressed,
Properties tableProperties,
org.apache.hadoop.util.Progressable progress)
throws IOException
- create the final out file, and output an empty key as the key.
- Specified by:
getHiveRecordWriter
in interface HiveOutputFormat<org.apache.hadoop.io.WritableComparable,org.apache.hadoop.io.Writable>
- Parameters:
jc
- the job configuration filefinalOutPath
- the final output file to be createdvalueClass
- the value class used for createisCompressed
- whether the content is compressed or nottableProperties
- the tableInfo of this file's corresponding tableprogress
- progress used for status report
- Returns:
- the RecordWriter for the output file
- Throws:
IOException
Copyright © 2011 The Apache Software Foundation