org.apache.nutch.fetcher
Class Fetcher
java.lang.Object
org.apache.hadoop.conf.Configured
org.apache.nutch.fetcher.Fetcher
- All Implemented Interfaces:
- Configurable, JobConfigurable, MapRunnable
- public class Fetcher
- extends Configured
- implements MapRunnable
The fetcher. Most of the work is done by plugins.
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
LOG
public static final org.apache.commons.logging.Log LOG
SIGNATURE_KEY
public static final String SIGNATURE_KEY
- See Also:
- Constant Field Values
SEGMENT_NAME_KEY
public static final String SEGMENT_NAME_KEY
- See Also:
- Constant Field Values
SCORE_KEY
public static final String SCORE_KEY
- See Also:
- Constant Field Values
Fetcher
public Fetcher()
Fetcher
public Fetcher(Configuration conf)
configure
public void configure(JobConf job)
- Specified by:
configure
in interface JobConfigurable
close
public void close()
isParsing
public static boolean isParsing(Configuration conf)
isStoringContent
public static boolean isStoringContent(Configuration conf)
run
public void run(RecordReader input,
OutputCollector output,
Reporter reporter)
throws IOException
- Specified by:
run
in interface MapRunnable
- Throws:
IOException
fetch
public void fetch(Path segment,
int threads,
boolean parsing)
throws IOException
- Throws:
IOException
main
public static void main(String[] args)
throws Exception
- Run the fetcher.
- Throws:
Exception
Copyright © 2006 The Apache Software Foundation