public class ScoreUpdater extends Configured implements Tool
Modifier and Type | Class and Description |
---|---|
static class |
ScoreUpdater.ScoreUpdaterMapper
Changes input into ObjectWritables.
|
static class |
ScoreUpdater.ScoreUpdaterReducer
Creates new CrawlDatum objects with the updated score from the NodeDb or
with a cleared score.
|
Constructor and Description |
---|
ScoreUpdater() |
Modifier and Type | Method and Description |
---|---|
static void |
main(java.lang.String[] args) |
int |
run(java.lang.String[] args)
Runs the ScoreUpdater tool.
|
void |
update(Path crawlDb,
Path webGraphDb)
Updates the inlink score in the web graph node databsae into the crawl
database.
|
getConf, setConf
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
getConf, setConf
public void update(Path crawlDb, Path webGraphDb) throws java.io.IOException, java.lang.ClassNotFoundException, java.lang.InterruptedException
crawlDb
- The crawl database to updatewebGraphDb
- The webgraph database to use.java.io.IOException
- If an error occurs while updating the scores.java.lang.ClassNotFoundException
java.lang.InterruptedException
public static void main(java.lang.String[] args) throws java.lang.Exception
java.lang.Exception
Copyright © 2018 The Apache Software Foundation