|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.mapred.FileOutputFormat<org.apache.hadoop.io.WritableComparable,BytesRefArrayWritable>
org.apache.hadoop.hive.ql.io.RCFileOutputFormat
public class RCFileOutputFormat
RCFileOutputFormat.
Constructor Summary | |
---|---|
RCFileOutputFormat()
|
Method Summary | |
---|---|
static int |
getColumnNumber(org.apache.hadoop.conf.Configuration conf)
Returns the number of columns set in the conf for writers. |
FileSinkOperator.RecordWriter |
getHiveRecordWriter(org.apache.hadoop.mapred.JobConf jc,
org.apache.hadoop.fs.Path finalOutPath,
Class<? extends org.apache.hadoop.io.Writable> valueClass,
boolean isCompressed,
Properties tableProperties,
org.apache.hadoop.util.Progressable progress)
create the final out file. |
org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.WritableComparable,BytesRefArrayWritable> |
getRecordWriter(org.apache.hadoop.fs.FileSystem ignored,
org.apache.hadoop.mapred.JobConf job,
String name,
org.apache.hadoop.util.Progressable progress)
|
static void |
setColumnNumber(org.apache.hadoop.conf.Configuration conf,
int columnNum)
set number of columns into the given configuration. |
Methods inherited from class org.apache.hadoop.mapred.FileOutputFormat |
---|
checkOutputSpecs, getCompressOutput, getOutputCompressorClass, getOutputPath, getPathForCustomFile, getTaskOutputPath, getUniqueName, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public RCFileOutputFormat()
Method Detail |
---|
public static void setColumnNumber(org.apache.hadoop.conf.Configuration conf, int columnNum)
conf
- configuration instance which need to set the column numbercolumnNum
- column number for RCFile's Writerpublic static int getColumnNumber(org.apache.hadoop.conf.Configuration conf)
conf
-
public org.apache.hadoop.mapred.RecordWriter<org.apache.hadoop.io.WritableComparable,BytesRefArrayWritable> getRecordWriter(org.apache.hadoop.fs.FileSystem ignored, org.apache.hadoop.mapred.JobConf job, String name, org.apache.hadoop.util.Progressable progress) throws IOException
getRecordWriter
in interface org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.WritableComparable,BytesRefArrayWritable>
getRecordWriter
in class org.apache.hadoop.mapred.FileOutputFormat<org.apache.hadoop.io.WritableComparable,BytesRefArrayWritable>
IOException
public FileSinkOperator.RecordWriter getHiveRecordWriter(org.apache.hadoop.mapred.JobConf jc, org.apache.hadoop.fs.Path finalOutPath, Class<? extends org.apache.hadoop.io.Writable> valueClass, boolean isCompressed, Properties tableProperties, org.apache.hadoop.util.Progressable progress) throws IOException
getHiveRecordWriter
in interface HiveOutputFormat<org.apache.hadoop.io.WritableComparable,org.apache.hadoop.io.Writable>
jc
- the job configuration filefinalOutPath
- the final output file to be createdvalueClass
- the value class used for createisCompressed
- whether the content is compressed or nottableProperties
- the tableInfo of this file's corresponding tableprogress
- progress used for status report
IOException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |