public class LinkDumper extends Configured implements Tool
Modifier and Type | Class and Description |
---|---|
static class |
LinkDumper.Inverter
Inverts outlinks from the WebGraph to inlinks and attaches node
information.
|
static class |
LinkDumper.LinkNode
Bean class which holds url to node information.
|
static class |
LinkDumper.LinkNodes
Writable class which holds an array of LinkNode objects.
|
static class |
LinkDumper.Merger
Merges LinkNode objects into a single array value per url.
|
static class |
LinkDumper.Reader
Reader class which will print out the url and all of its inlinks to system
out.
|
Modifier and Type | Field and Description |
---|---|
static java.lang.String |
DUMP_DIR |
Constructor and Description |
---|
LinkDumper() |
Modifier and Type | Method and Description |
---|---|
void |
dumpLinks(Path webGraphDb)
Runs the inverter and merger jobs of the LinkDumper tool to create the url
to inlink node database.
|
static void |
main(java.lang.String[] args) |
int |
run(java.lang.String[] args)
Runs the LinkDumper tool.
|
getConf, setConf
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
getConf, setConf
public static final java.lang.String DUMP_DIR
public void dumpLinks(Path webGraphDb) throws java.io.IOException, java.lang.InterruptedException, java.lang.ClassNotFoundException
java.io.IOException
java.lang.InterruptedException
java.lang.ClassNotFoundException
public static void main(java.lang.String[] args) throws java.lang.Exception
java.lang.Exception
Copyright © 2018 The Apache Software Foundation