Package | Description |
---|---|
org.apache.nutch.scoring.webgraph |
Modifier and Type | Method and Description |
---|---|
void |
Loops.Finalizer.map(org.apache.hadoop.io.Text key,
Loops.Route value,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,Loops.Route> output,
org.apache.hadoop.mapred.Reporter reporter)
Maps out and found routes, those will be the link cycles.
|
Modifier and Type | Method and Description |
---|---|
void |
Loops.Finalizer.map(org.apache.hadoop.io.Text key,
Loops.Route value,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,Loops.Route> output,
org.apache.hadoop.mapred.Reporter reporter)
Maps out and found routes, those will be the link cycles.
|
void |
Loops.Finalizer.reduce(org.apache.hadoop.io.Text key,
Iterator<Loops.Route> values,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,Loops.LoopSet> output,
org.apache.hadoop.mapred.Reporter reporter)
Aggregates all found routes for a given start url into a loopset and
collects the loopset.
|
void |
Loops.Initializer.reduce(org.apache.hadoop.io.Text key,
Iterator<org.apache.hadoop.io.ObjectWritable> values,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,Loops.Route> output,
org.apache.hadoop.mapred.Reporter reporter)
Takes any node that has inlinks and sets up a route for all of its
outlinks.
|
void |
Loops.Looper.reduce(org.apache.hadoop.io.Text key,
Iterator<org.apache.hadoop.io.ObjectWritable> values,
org.apache.hadoop.mapred.OutputCollector<org.apache.hadoop.io.Text,Loops.Route> output,
org.apache.hadoop.mapred.Reporter reporter)
Performs a single loop pass looking for loop cycles within routes.
|
Copyright © 2013 The Apache Software Foundation