org.apache.hadoop.hbase.mapreduce
Class SampleUploader

java.lang.Object
  extended by org.apache.hadoop.hbase.mapreduce.SampleUploader

public class SampleUploader
extends Object

Sample Uploader MapReduce

This is EXAMPLE code. You will need to change it to work for your context.

Uses TableReducer to put the data into HBase. Change the InputFormat to suit your data. In this example, we are importing a CSV file.

row,family,qualifier,value

The table and columnfamily we're to insert into must preexist.

There is no reducer in this example as it is not necessary and adds significant overhead. If you need to do any massaging of data before inserting into HBase, you can do this in the map as well.

Do the following to start the MR job:

 ./bin/hadoop org.apache.hadoop.hbase.mapreduce.SampleUploader /tmp/input.csv TABLE_NAME
 

This code was written against HBase 0.21 trunk.


Constructor Summary
SampleUploader()
           
 
Method Summary
static org.apache.hadoop.mapreduce.Job configureJob(org.apache.hadoop.conf.Configuration conf, String[] args)
          Job configuration.
static void main(String[] args)
          Main entry point.
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

SampleUploader

public SampleUploader()
Method Detail

configureJob

public static org.apache.hadoop.mapreduce.Job configureJob(org.apache.hadoop.conf.Configuration conf,
                                                           String[] args)
                                                    throws IOException
Job configuration.

Throws:
IOException

main

public static void main(String[] args)
                 throws Exception
Main entry point.

Parameters:
args - The command line parameters.
Throws:
Exception - When running the job fails.


Copyright © 2007–2015 The Apache Software Foundation. All rights reserved.