org.apache.mahout.utils.vectors.tfidf
Class TFIDFPartialVectorReducer

java.lang.Object
  extended by org.apache.hadoop.mapred.MapReduceBase
      extended by org.apache.mahout.utils.vectors.tfidf.TFIDFPartialVectorReducer
All Implemented Interfaces:
java.io.Closeable, org.apache.hadoop.mapred.JobConfigurable, org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.WritableComparable<?>,VectorWritable,org.apache.hadoop.io.WritableComparable<?>,VectorWritable>

public class TFIDFPartialVectorReducer
extends org.apache.hadoop.mapred.MapReduceBase
implements org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.WritableComparable<?>,VectorWritable,org.apache.hadoop.io.WritableComparable<?>,VectorWritable>

Converts a document in to a sparse vector


Constructor Summary
TFIDFPartialVectorReducer()
           
 
Method Summary
 void configure(org.apache.hadoop.mapred.JobConf job)
           
 void reduce(org.apache.hadoop.io.WritableComparable<?> key, java.util.Iterator<VectorWritable> values, org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.WritableComparable<?>,VectorWritable> output, org.apache.hadoop.mapred.Reporter reporter)
           
 
Methods inherited from class org.apache.hadoop.mapred.MapReduceBase
close
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 
Methods inherited from interface java.io.Closeable
close
 

Constructor Detail

TFIDFPartialVectorReducer

public TFIDFPartialVectorReducer()
Method Detail

reduce

public void reduce(org.apache.hadoop.io.WritableComparable<?> key,
                   java.util.Iterator<VectorWritable> values,
                   org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.WritableComparable<?>,VectorWritable> output,
                   org.apache.hadoop.mapred.Reporter reporter)
            throws java.io.IOException
Specified by:
reduce in interface org.apache.hadoop.mapred.Reducer<org.apache.hadoop.io.WritableComparable<?>,VectorWritable,org.apache.hadoop.io.WritableComparable<?>,VectorWritable>
Throws:
java.io.IOException

configure

public void configure(org.apache.hadoop.mapred.JobConf job)
Specified by:
configure in interface org.apache.hadoop.mapred.JobConfigurable
Overrides:
configure in class org.apache.hadoop.mapred.MapReduceBase


Copyright © 2008-2010 The Apache Software Foundation. All Rights Reserved.