org.apache.hadoop.hbase.mapreduce
Class TsvImporterTextMapper
java.lang.Object
org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text>
org.apache.hadoop.hbase.mapreduce.TsvImporterTextMapper
@InterfaceAudience.Public
@InterfaceStability.Evolving
public class TsvImporterTextMapper
- extends org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text>
Write table content out to map output files.
Method Summary |
protected void |
doSetup(org.apache.hadoop.mapreduce.Mapper.Context context)
Handles common parameter initialization that a subclass might want to leverage. |
org.apache.hadoop.mapreduce.Counter |
getBadLineCount()
|
boolean |
getSkipBadLines()
|
void |
incrementBadLineCount(int count)
|
void |
map(org.apache.hadoop.io.LongWritable offset,
org.apache.hadoop.io.Text value,
org.apache.hadoop.mapreduce.Mapper.Context context)
Convert a line of TSV text into an HBase table row. |
protected void |
setup(org.apache.hadoop.mapreduce.Mapper.Context context)
Handles initializing this class with objects specific to it (i.e., the parser). |
Methods inherited from class org.apache.hadoop.mapreduce.Mapper |
cleanup, run |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
TsvImporterTextMapper
public TsvImporterTextMapper()
getSkipBadLines
public boolean getSkipBadLines()
getBadLineCount
public org.apache.hadoop.mapreduce.Counter getBadLineCount()
incrementBadLineCount
public void incrementBadLineCount(int count)
setup
protected void setup(org.apache.hadoop.mapreduce.Mapper.Context context)
- Handles initializing this class with objects specific to it (i.e., the parser).
Common initialization that might be leveraged by a subsclass is done in
doSetup
. Hence a subclass may choose to override this method
and call doSetup
as well before handling it's own custom params.
- Overrides:
setup
in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text>
- Parameters:
context
-
doSetup
protected void doSetup(org.apache.hadoop.mapreduce.Mapper.Context context)
- Handles common parameter initialization that a subclass might want to leverage.
- Parameters:
context
-
map
public void map(org.apache.hadoop.io.LongWritable offset,
org.apache.hadoop.io.Text value,
org.apache.hadoop.mapreduce.Mapper.Context context)
throws IOException
- Convert a line of TSV text into an HBase table row.
- Overrides:
map
in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text>
- Throws:
IOException
Copyright © 2007–2016 The Apache Software Foundation. All rights reserved.