|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.mapred.OutputFormatBase<Text,MapWritable>
org.apache.hadoop.hbase.mapred.TableOutputFormat
public class TableOutputFormat
Convert Map/Reduce output and write it to an HBase table
Nested Class Summary | |
---|---|
protected class |
TableOutputFormat.TableRecordWriter
Convert Reduce output (key, value) to (HStoreKey, KeyedDataArrayWritable) and write to an HBase table |
Field Summary | |
---|---|
static String |
OUTPUT_TABLE
JobConf parameter that specifies the output table |
Constructor Summary | |
---|---|
TableOutputFormat()
constructor |
Method Summary | |
---|---|
void |
checkOutputSpecs(FileSystem ignored,
JobConf job)
Check for validity of the output-specification for the job. |
RecordWriter |
getRecordWriter(FileSystem ignored,
JobConf job,
String name,
Progressable progress)
Get the RecordWriter for the given job. |
Methods inherited from class org.apache.hadoop.mapred.OutputFormatBase |
---|
getCompressOutput, getOutputCompressorClass, setCompressOutput, setOutputCompressorClass |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
public static final String OUTPUT_TABLE
Constructor Detail |
---|
public TableOutputFormat()
Method Detail |
---|
public RecordWriter getRecordWriter(FileSystem ignored, JobConf job, String name, Progressable progress) throws IOException
RecordWriter
for the given job.
getRecordWriter
in interface OutputFormat<Text,MapWritable>
getRecordWriter
in class OutputFormatBase<Text,MapWritable>
job
- configuration for the job whose output is being written.name
- the unique name for this part of the output.progress
- mechanism for reporting progress while writing to file.
RecordWriter
to write the output for the job.
IOException
public void checkOutputSpecs(FileSystem ignored, JobConf job) throws FileAlreadyExistsException, InvalidJobConfException, IOException
This is to validate the output specification for the job when it is a job is submitted. Typically checks that it does not already exist, throwing an exception when it already exists, so that output is not overwritten.
checkOutputSpecs
in interface OutputFormat<Text,MapWritable>
checkOutputSpecs
in class OutputFormatBase<Text,MapWritable>
job
- job configuration.
IOException
- when output should not be attempted
FileAlreadyExistsException
InvalidJobConfException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |