org.apache.mahout.clustering.lda
Class LDAWordTopicMapper
java.lang.Object
org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.WritableComparable<?>,VectorWritable,IntPairWritable,org.apache.hadoop.io.DoubleWritable>
org.apache.mahout.clustering.lda.LDAWordTopicMapper
public class LDAWordTopicMapper
- extends org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.WritableComparable<?>,VectorWritable,IntPairWritable,org.apache.hadoop.io.DoubleWritable>
Runs inference on the input documents (which are sparse vectors of word counts) and outputs the sufficient
statistics for the word-topic assignments.
Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper |
org.apache.hadoop.mapreduce.Mapper.Context |
Method Summary |
void |
configure(org.apache.hadoop.conf.Configuration job)
|
void |
configure(LDAState myState)
|
protected void |
map(org.apache.hadoop.io.WritableComparable<?> key,
VectorWritable wordCountsWritable,
org.apache.hadoop.mapreduce.Mapper.Context context)
|
protected void |
setup(org.apache.hadoop.mapreduce.Mapper.Context context)
|
Methods inherited from class org.apache.hadoop.mapreduce.Mapper |
cleanup, run |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
LDAWordTopicMapper
public LDAWordTopicMapper()
map
protected void map(org.apache.hadoop.io.WritableComparable<?> key,
VectorWritable wordCountsWritable,
org.apache.hadoop.mapreduce.Mapper.Context context)
throws IOException,
InterruptedException
- Overrides:
map
in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.WritableComparable<?>,VectorWritable,IntPairWritable,org.apache.hadoop.io.DoubleWritable>
- Throws:
IOException
InterruptedException
configure
public void configure(LDAState myState)
configure
public void configure(org.apache.hadoop.conf.Configuration job)
setup
protected void setup(org.apache.hadoop.mapreduce.Mapper.Context context)
- Overrides:
setup
in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.WritableComparable<?>,VectorWritable,IntPairWritable,org.apache.hadoop.io.DoubleWritable>
Copyright © 2008-2012 The Apache Software Foundation. All Rights Reserved.