public static class DeduplicationJob.DedupReducer extends Reducer<BytesWritable,CrawlDatum,Text,CrawlDatum>
Reducer.Context
Constructor and Description |
---|
DedupReducer() |
Modifier and Type | Method and Description |
---|---|
void |
reduce(BytesWritable key,
java.lang.Iterable<CrawlDatum> values,
Reducer.Context context) |
void |
setup(Reducer.Context context) |
public void setup(Reducer.Context context)
setup
in class Reducer<BytesWritable,CrawlDatum,Text,CrawlDatum>
public void reduce(BytesWritable key, java.lang.Iterable<CrawlDatum> values, Reducer.Context context) throws java.io.IOException, java.lang.InterruptedException
reduce
in class Reducer<BytesWritable,CrawlDatum,Text,CrawlDatum>
java.io.IOException
java.lang.InterruptedException
Copyright © 2019 The Apache Software Foundation