org.apache.hadoop.hbase.mapreduce
Class HFileOutputFormat

java.lang.Object
  extended by org.apache.hadoop.mapreduce.OutputFormat<K,V>
      extended by org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<ImmutableBytesWritable,KeyValue>
          extended by org.apache.hadoop.hbase.mapreduce.HFileOutputFormat

public class HFileOutputFormat
extends org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<ImmutableBytesWritable,KeyValue>

Writes HFiles. Passed KeyValues must arrive in order. Currently, can only write files to a single column family at a time. Multiple column families requires coordinating keys cross family. Writes current time as the sequence id for the file. Sets the major compacted attribute on created hfiles. Calling write(null,null) will forceably roll all HFiles being written.

See Also:
KeyValueSortReducer

Nested Class Summary
 
Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.Counter
 
Field Summary
 
Fields inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
BASE_OUTPUT_NAME, PART
 
Constructor Summary
HFileOutputFormat()
           
 
Method Summary
static void configureIncrementalLoad(org.apache.hadoop.mapreduce.Job job, HTable table)
          Configure a MapReduce Job to perform an incremental load into the given table.
 org.apache.hadoop.mapreduce.RecordWriter<ImmutableBytesWritable,KeyValue> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
           
 
Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat
checkOutputSpecs, getCompressOutput, getDefaultWorkFile, getOutputCommitter, getOutputCompressorClass, getOutputName, getOutputPath, getPathForWorkFile, getUniqueFile, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputName, setOutputPath
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

HFileOutputFormat

public HFileOutputFormat()
Method Detail

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter<ImmutableBytesWritable,KeyValue> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                          throws IOException,
                                                                                                 InterruptedException
Specified by:
getRecordWriter in class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<ImmutableBytesWritable,KeyValue>
Throws:
IOException
InterruptedException

configureIncrementalLoad

public static void configureIncrementalLoad(org.apache.hadoop.mapreduce.Job job,
                                            HTable table)
                                     throws IOException
Configure a MapReduce Job to perform an incremental load into the given table. This The user should be sure to set the map output value class to either KeyValue or Put before running this function.

Throws:
IOException


Copyright © 2013 The Apache Software Foundation. All Rights Reserved.