org.apache.nutch.crawl
Class Injector

java.lang.Object
  extended byorg.apache.hadoop.conf.Configured
      extended byorg.apache.nutch.crawl.Injector
All Implemented Interfaces:
Configurable

public class Injector
extends Configured

This class takes a flat file of URLs and adds them to the of pages to be crawled. Useful for bootstrapping the system.


Nested Class Summary
static class Injector.InjectMapper
          Normalize and filter injected urls.
static class Injector.InjectReducer
          Combine multiple new entries for a url.
 
Field Summary
static org.apache.commons.logging.Log LOG
           
 
Constructor Summary
Injector(Configuration conf)
          Construct an Injector.
 
Method Summary
 void inject(Path crawlDb, Path urlDir)
           
static void main(String[] args)
           
 
Methods inherited from class org.apache.hadoop.conf.Configured
getConf, setConf
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

LOG

public static final org.apache.commons.logging.Log LOG
Constructor Detail

Injector

public Injector(Configuration conf)
Construct an Injector.

Method Detail

inject

public void inject(Path crawlDb,
                   Path urlDir)
            throws IOException
Throws:
IOException

main

public static void main(String[] args)
                 throws Exception
Throws:
Exception


Copyright © 2006 The Apache Software Foundation