org.apache.mahout.clustering.lda
Class LDAWordTopicMapper

java.lang.Object
  extended by org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.WritableComparable<?>,VectorWritable,IntPairWritable,org.apache.hadoop.io.DoubleWritable>
      extended by org.apache.mahout.clustering.lda.LDAWordTopicMapper

public class LDAWordTopicMapper
extends org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.WritableComparable<?>,VectorWritable,IntPairWritable,org.apache.hadoop.io.DoubleWritable>

Runs inference on the input documents (which are sparse vectors of word counts) and outputs the sufficient statistics for the word-topic assignments.


Nested Class Summary
 
Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper
org.apache.hadoop.mapreduce.Mapper.Context
 
Constructor Summary
LDAWordTopicMapper()
           
 
Method Summary
 void configure(org.apache.hadoop.conf.Configuration job)
           
 void configure(LDAState myState)
           
protected  void map(org.apache.hadoop.io.WritableComparable<?> key, VectorWritable wordCountsWritable, org.apache.hadoop.mapreduce.Mapper.Context context)
           
protected  void setup(org.apache.hadoop.mapreduce.Mapper.Context context)
           
 
Methods inherited from class org.apache.hadoop.mapreduce.Mapper
cleanup, run
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

LDAWordTopicMapper

public LDAWordTopicMapper()
Method Detail

map

protected void map(org.apache.hadoop.io.WritableComparable<?> key,
                   VectorWritable wordCountsWritable,
                   org.apache.hadoop.mapreduce.Mapper.Context context)
            throws IOException,
                   InterruptedException
Overrides:
map in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.WritableComparable<?>,VectorWritable,IntPairWritable,org.apache.hadoop.io.DoubleWritable>
Throws:
IOException
InterruptedException

configure

public void configure(LDAState myState)

configure

public void configure(org.apache.hadoop.conf.Configuration job)

setup

protected void setup(org.apache.hadoop.mapreduce.Mapper.Context context)
Overrides:
setup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.WritableComparable<?>,VectorWritable,IntPairWritable,org.apache.hadoop.io.DoubleWritable>


Copyright © 2008-2012 The Apache Software Foundation. All Rights Reserved.